Senior Data Software Engineer (Databricks)

We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal. You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.

Responsibilities

Design, develop and maintain scalable data pipelines and architectures Optimize data models and enhance ETL processes utilizing Databricks and related technologies Implement rigorous data quality checks and monitoring to guarantee high integrity Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools Troubleshoot and resolve data-related issues promptly Participate in code reviews ensuring adherence to high standards of code quality Requirements Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies Solid understanding of data architecture and data modeling skills Expertise in Spark, using either Scala or Py.

Spark Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks Engineering background in AWS, Azure or GCP Experience with big data and performance optimization of data-intensive applications Proactive approach and prior client-facing experience Ability to navigate ambiguity and work independently Desire to engage in a transparent, fast-moving startup environment Fluent English communication skills at a B2+ level or higher