Senior Data Engineer – Java Spark Cloud-Native Applications
Unleash transformative data solutions — drive innovation at the forefront of cloud\-native technologies!
Lisbon\-based opportunity with hybrid work model (up to 3 days remote per week).
As a Senior Data Engineer, you will be working for our client, a leader in data\-driven solutions, focusing on the conception and development of a robust Data Processing platform using Spark in a dynamic and multicultural environment. You will contribute to shaping scalable and efficient data pipelines that empower strategic decision\-making and innovation.
Your main responsibilities:
- Design and develop high\-performance data processing applications utilizing Apache Spark in batch mode.
- Implement solutions with Java 9\+ and Spring frameworks, incorporating modern language features like lambdas, streams, and futures.
- Collaborate on cloud\-native architectures using Docker and Kubernetes to ensure scalable deployment.
- Optimize performance and troubleshoot complex data workflows, ensuring stability and efficiency.
- Work with relational databases such as PostgreSQL and Oracle ExaCC, and manage object storage solutions like S3\.
- Contribute to CI/CD pipelines using tools like Maven, GitLab, ArgoCD, and Liquibase to streamline development.
- Apply best practices in solution design, pattern implementation, and performance tuning.
- Participate in code reviews and knowledge sharing to foster continuous improvement.
- At least 8 years of experience in Java/J2EE development, preferably in Data Processing contexts.
- Minimum of 1\-year hands\-on experience with Apache Spark.
- Strong proficiency with cloud\-native applications, Docker, and Kubernetes.
- Solid understanding of modern Java features, including lambdas, streams, and futures.
- Experience with transactional SQL and Spark SQL.
- Knowledge of relational databases like PostgreSQL and Oracle ExaCC.
- Familiarity with CI/CD tooling such as Maven, GitLab, and Liquibase.
- Good command of English (fluent) and French (B2 level).
- Experience with Argo Workflow.
- French language skills at B2 level.
- Fluent English and French.
- Only candidates with an existing legal right to work in Europe will be considered for this role.
Interested? Apply now and include your CV in English or Polish, along with a statement confirming your consent to the processing and storage of your personal data.
\<endereço ocultado\>
Poderá encontrar o anúncio original publicado em: https://www.itjobs.pt/oferta/512967/senior\-data\-engineer\-java\-spark\-cloud\-native\-applications
Este anúncio é de indeed. Ver anúncio original ↗