Senior Python Developer

Vellore, India · Full time · Posted May 5, 2025

Job Description: Senior Python Developer
Location: Vellore, Tamil Nadu
Job Summary
We are looking for a highly skilled Senior Python Developer with strong expertise in Python, ETL development, SQL, data integration, and workflow automation. The candidate will take ownership of developing and optimizing robust data solutions that support business-critical operations and large-scale client data delivery.
The role requires hands-on experience in building efficient ETL pipelines, integrating multiple data sources, managing large datasets, automating workflows, and developing reliable file generation and delivery solutions. The ideal candidate should demonstrate strong technical problem-solving abilities, database optimization skills, and a proactive approach to improving system performance, reliability, and maintainability.
The candidate will also contribute to technical design decisions, establish coding standards, mentor junior developers, and collaborate with cross-functional teams to deliver high-quality solutions within defined timelines.
Key Responsibilities
  1. Python Application Development: Design and develop modular, reusable, and maintainable Python applications for data-intensive workloads, business automation, and system integration.
  2. ETL Pipeline Development: Build and maintain reliable ETL pipelines to ingest data from multiple sources, apply business rules, validate results, and deliver structured outputs to downstream systems.
  3. SQL and Database Optimization: Develop complex SQL queries, stored procedures, and efficient database operations. Identify performance bottlenecks and optimize query execution, indexing strategies, and bulk data operations.
  4. Large-Scale Data Processing: Develop efficient solutions for handling large datasets while optimizing execution time, memory consumption, and system resource utilization.
  5. API and System Integration: Develop and integrate REST APIs and connect external data providers, databases, internal applications, and client platforms to enable seamless data exchange.
  6. Client File Generation and Delivery: Develop automated solutions to generate client-specific files in CSV, JSON, XML, Excel, and other required formats, ensuring compliance with business specifications and delivery schedules.
  7. Data Quality and Reconciliation: Implement validation rules, reconciliation checks, duplicate detection, and exception handling to maintain data accuracy, completeness, and consistency.
  8. Workflow Orchestration and Automation: Automate recurring jobs and dependencies using scheduling and orchestration tools such as Apache Airflow and cron, with appropriate failure handling and recovery mechanisms.
  9. Production Support and Incident Resolution: Investigate and resolve complex production issues involving Python applications, databases, scheduled workflows, file generation, and data delivery. Perform root-cause analysis and implement preventive measures.
  10. System Reliability and Monitoring: Implement structured logging, monitoring, alerting, retry mechanisms, and operational safeguards to improve application stability and reduce manual intervention.
  11. Code Quality and Technical Standards: Establish and follow coding standards, conduct code reviews, write unit tests, maintain technical documentation, and promote reusable software design practices.
  12. Technical Leadership: Guide junior developers through code reviews, troubleshooting, technical discussions, and knowledge sharing. Take ownership of assigned deliverables and support effective execution across projects.
  13. Cross-functional Collaboration: Work closely with relevant technical and business teams to clarify requirements, resolve dependencies, coordinate releases, and ensure successful implementation of data solutions.
  14. Continuous Optimization: Identify opportunities to modernize existing scripts, eliminate inefficient processes, improve automation, and enhance the performance and scalability of existing systems.
Requirements
  • 5–6 years of professional experience in Python development, with substantial hands-on experience in ETL, data integration, or data-intensive applications.
  • Strong proficiency in Python, including object-oriented programming, data structures, exception handling, modular design, and application debugging.
  • Proven experience developing and maintaining ETL pipelines and automated data workflows.
  • Strong SQL expertise, including complex joins, subqueries, CTEs, temporary tables, aggregations, stored procedures, and query performance optimization.
  • Experience working with relational databases such as Microsoft SQL Server, PostgreSQL, or MySQL.
  • Hands-on experience with Pandas and NumPy for data manipulation and efficient dataset handling.
  • Experience integrating REST APIs and working with structured data formats such as JSON, XML, CSV, and Excel.
  • Strong understanding of data validation, reconciliation, logging, exception handling, and failure recovery.
  • Experience with batch processing, job scheduling, and automation of recurring workloads.
  • Proficiency in Linux commands, shell scripting, and cron-based scheduling.
  • Experience using Git for version control, branching, merging, and collaborative development.
  • Ability to troubleshoot complex technical issues and optimize Python applications and database operations.
  • Understanding of software development lifecycle (SDLC), unit testing, code reviews, and technical documentation.
  • Strong analytical thinking, ownership, communication, and collaboration skills.
  • Ability to manage multiple priorities, deliver independently, and provide technical guidance to junior developers.
Preferred Skills (Good to Have)
  • Experience with Apache Airflow or similar workflow orchestration platforms.
  • Hands-on experience with SFTP/FTP integrations and automated file transfer mechanisms.
  • Knowledge of cloud services covering storage, compute, serverless computing, monitoring, and access management.
  • Experience developing REST APIs using FastAPI, Flask, or Django.
  • Experience with web scraping and automated data acquisition using BeautifulSoup, Scrapy, Selenium, or Playwright.
  • Familiarity with Docker and containerized application deployment.
  • Experience with Redis, Celery, or asynchronous task processing.
  • Knowledge of CI/CD pipelines, deployment automation, and release management.
  • Experience optimizing memory usage, batch sizes, database transactions, and processing performance for large datasets.
  • Familiarity with production monitoring, incident management, and operational support practices.
Success Criteria for the Role
  • Develop reliable and maintainable Python solutions that meet business and technical requirements.
  • Improve the performance and scalability of ETL pipelines, SQL operations, and data workflows.
  • Ensure accurate, complete, and timely generation and delivery of client-specific data files.
  • Reduce manual intervention and recurring failures through effective automation and preventive controls.
  • Maintain high standards of code quality, system reliability, documentation, and operational readiness.
  • Demonstrate technical ownership, sound problem-solving, and the ability to guide junior developers.