Azure Databricks Engineer- 3+ Months- USA- ASAP- Remote
About the position
Global Enterprise Partners is seeking an experienced Azure Data Engineer for a contract project with a global Agri science client. The role focuses on designing, building, and maintaining data pipelines using various Azure technologies and best practices in DataOps and MLOps to enhance system performance.
Responsibilities
• Design, build, and maintain data pipelines using Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.
• Implement DataOps and MLOps best practices to optimize data system performance.
• Enhance data pipelines for fault tolerance and performance improvement.
• Drive process improvement through tracking, training, and sharing knowledge.
• Mentor junior Azure Data Engineers.
Requirements
• Proven experience in data engineering, building and maintaining data pipelines, and ETL processes.
• Proven experience building and maintaining data products within Databricks.
• Hands-on experience with Databricks and its ecosystem.
• Proficient in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.
• Skilled in programming languages such as Python, Scala, SQL, and Java.
• Knowledge of relational and NoSQL databases, data modeling, and query optimization.
Nice-to-haves
• Databricks Certifications (beneficial but not required).
• Cloud Certifications such as Azure or similar (advantageous).
Benefits
• Remote work options available.
• Flexible working hours.
Apply tot his job
Apply To this Job