Python Data Extraction Engineer

Python Data Extraction Engineer – Web Scraping & Government Data Location: Coimbatore Experience: 3–7 years Role Type: Full-time About the Role We are building a data intelligence platform that looks to analyze fragmented public information into structured, actionable business data. We are looking for a strong Python Data Extraction Engineer who can discover, extract, clean, normalize and integrate data from government portals, public websites, PDFs, APIs and other open data sources.

This is not a conventional application-development role. The ideal candidate enjoys solving difficult data-acquisition problems involving poorly structured websites, inconsistent government portals, changing schemas, PDFs, JavaScript-rendered pages and large volumes of semi-structured information. What You Will Own You will build and maintain the data-acquisition layer of the platform.

Key responsibilities include

Identify and evaluate government and public data sources relevant to property, businesses and commercial activity. Build Python-based crawlers and extraction pipelines for government portals and public websites. Extract structured information from HTML pages, tables, PDFs, downloadable files and publicly accessible APIs.

Work with JavaScript-rendered websites and multi-step public search interfaces. Automate recurring extraction from multiple sources while respecting applicable access rules, rate limits, and terms. Clean, standardize and normalize inconsistent data from different government authorities. Perform entity matching and record linkage across datasets using fields such as owner name, company name, address, survey number, coordinates and project information.

Develop mechanisms to detect website/schema changes and extraction failures. Build validation and QA processes to measure completeness and accuracy. Store extracted information in structured databases and expose clean datasets to downstream applications. Work closely with GIS, product and engineering teams to combine location-based signals with government/public records.

Research new public and open-data sources that can improve the accuracy and completeness of our intelligence. Examples of Data Sources The work may involve sources such as: Municipal corporation portals State planning and development authorities DTCP and similar planning authorities RERA databases Building and planning permission records Land and property records Tender and procurement portals Company/business registries Government open-data portals Environmental and regulatory approvals Public notices and downloadable government documents Maps and geospatial datasets Other legally accessible public and open-source information Required Technical Skills Strong hands-on experience with: Python Web scraping and crawling Requests / HTTP clients Beautiful.

Soup / lxml Selenium and/or Playwright REST APIs and JSON HTML/XML parsing Pandas SQL Data cleaning and transformation Regex and text processing ETL/data pipelines Git What We Are Looking For We particularly want someone who is a problem solver rather than simply a Python programmer . The candidate should be able to investigate the available sources, understand how the underlying website works, determine the best extraction approach, build the pipeline and validate the resulting data.

Ideal Background Candidates may come from backgrounds such as: Web scraping / data extraction companies Alternative-data companies Prop. Tech / real-estate data companies Market-intelligence companies OSINT/data intelligence companies Government-data projects Data aggregation platforms Lead/data enrichment companies GIS/location-intelligence companies Success in This Role Within the first few months, the successful candidate should be able to: Map relevant government/public data sources.

Build reliable extraction pipelines across multiple portals. Convert fragmented information into standardized records. Cross-reference records from multiple sources. Establish automated QA and monitoring. Continuously discover additional datasets that improve our product's coverage and accuracy. The objective is not simply to scrape websites.

It is to build a scalable public-data acquisition and enrichment engine that becomes a core component of our intelligence platform.

Requirements

Python, pandas, webscraping, web crawling,selenium postman