Senior Python Data Engineer with AI

We are seeking a highly skilled Senior Python Developer to join our dynamic team and play a pivotal role in building scalable, robust APIs and innovative backend solutions for generative AI applications. This position will involve close collaboration with cross-functional teams to deliver high-performance, well-architected solutions aimed at solving complex problems.

Responsibilities

Develop and deploy scalable RESTful APIs to serve web apps and integrations with other software Ensure API performance, scalability, and maintainability with focus on clear, concise code and robust logging/monitoring Support and optimize database integrations, ensuring efficient data modeling and query performance Collaborate with data engineers on pipelines and orchestration frameworks to deliver clean, organized data to APIs Conduct thorough unit and integration testing in collaboration with testing teams Review code from peers to ensure high-quality solutions and provide constructive feedback Create and maintain technical documentation for solutions and Software Development Lifecycle (SDLC) processes Apply modern software design best practices including version control, containerization, and scalable service design Work collaboratively with product teams throughout all phases of the development lifecycle Requirements 5+ years of professional experience in Python-focused backend development Extensive experience with at least one Python backend framework, such as FastAPI Proficiency in asynchronous programming and advanced Python development Expertise in relational database systems, including PostgreSQL and data modeling Knowledge of RESTful API design principles and modern software development practices Familiarity with scalable architecture patterns, containerization tools, and cloud-based operations Extensive background in version control systems and CI/CD pipelines Experience working with data engineering frameworks, such as Spark or Py.

Spark, and orchestration tools like Airflow is a plus Nice to have Knowledge of Amazon Redshift and Databricks for data engineering workflows Background in ETL/ELT solutions for data transformation and loading Skills in leveraging Apache Airflow for orchestration frameworks Familiarity with Py. Spark and GitHub Actions for workflow automation and development pipelines