Senior Databricks Engineer
Location: Lisbon, Portugal \| Hybrid (3 days/week on\-site)
About the role
We are hiring two Senior Databricks Engineers to join an established data engineering team within an international technology services group. You will design, build and operate data solutions on the Databricks Lakehouse Platform, owning the full lifecycle from architecture and development to production deployment and operational support.
We are looking for autonomous engineers who can turn ambiguous business requirements into scalable, production\-ready data solutions and take full ownership of their technical decisions.
Key responsibilities
- Design, build and maintain scalable data pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL and Python.
- Design and optimize Delta Lake tables, including partitioning, schema evolution and performance tuning.
- Implement layered data architectures (Raw, Cleansed and Curated).
- Build and manage workflows with Databricks Jobs, Workflows and Delta Live Tables.
- Optimize Spark workloads: partitioning, caching, shuffling, join strategies and file sizing.
- Manage cluster configurations and monitor platform cost efficiency.
- Implement logging, monitoring, alerting and recovery mechanisms for reliable operations.
- Integrate data quality controls throughout the pipeline lifecycle.
- Work within Unity Catalog to support governance, lineage and access control.
- Take part in code reviews and CI/CD\-driven delivery.
- Collaborate in Agile ceremonies and maintain technical documentation and design decisions.
- 6\+ years of professional experience in Data Engineering.
- Significant hands\-on experience with Databricks in production environments.
- Strong expertise in Apache Spark, PySpark and Spark SQL.
- Proven practical experience with Delta Lake.
- Advanced Python and SQL skills.
- Experience designing, deploying and supporting production\-grade data pipelines.
- Experience with Git and CI/CD practices.
- Knowledge of Databricks Workflows, Jobs and Delta Live Tables.
- Bachelor's or Master's degree in Computer Science, IT, Engineering or a related field.
- Fluent English, written and spoken.
- Unity Catalog, data governance and lineage.
- Cloud experience with Azure, AWS and/or GCP.
- Terraform, Databricks Asset Bundles, dbt or Airflow.
- Databricks certification (Data Engineer Associate or Professional).
- Exposure to MLflow and Databricks ML workflows.
- Experience in product engineering environments.
- An attractive salary package and a good work\-life balance.
- Large\-scale international data platforms and modern cloud and data technologies.
- Tailor\-made training aligned with your professional goals.
- A friendly, collaborative and entrepreneurial environment.
Mind\-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.
100% Remote opportunities
We want you to have the flexibility to work where you feel most comfortable and productive.
International Career
- You can expect professional growth and to be connect with the world.
- We are represented in Portugal, Belgium, Luxembourg, and Denmark.
- And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)
If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!
As a plus, we provide Health and Life Insurance.
Este anúncio é de Indeed. Ver anúncio original ↗