**Experienced Full Stack Data Engineer – Cloud and Big Data Application Development at arenaflex**
**Job Summary:**
Join arenaflex, a leading entertainment and media company, as a Lead Data Engineer in our Information and Investigation group for Disney Web-based features (DSS). We're seeking a highly motivated and skilled professional to lead the development of our data items and data centers around Commitment and Maintenance Examination and Information Science. As a key member of our team, you will be responsible for designing and implementing cutting-edge data solutions, collaborating with cross-functional teams, and ensuring high-quality data management.
**About arenaflex:**
arenaflex is a global leader in the entertainment and media industry, with a rich history of innovation and creativity. Our company is committed to delivering exceptional experiences to our clients, sponsors, and content partners. We're passionate about harnessing the power of data to drive business growth, improve customer engagement, and inform strategic decision-making.
**Job Description:**
As a Lead Data Engineer at arenaflex, you will play a critical role in shaping our data strategy and driving business outcomes. Your primary responsibilities will include:
Key Responsibilities:
- Add to the design and development of our data items and data centers around Commitment and Maintenance Examination and Information Science.
- Plan and develop flexible data warehousing solutions, building ETL pipelines in Large Data conditions (cloud, on-prem, hybrid).
- Help engineer data solutions/structures and define data models for the core data warehouse and data shops.
- Collaborate with Data Product Managers, Data Modelers, and Data Architects to design, implement, and deliver successful data solutions.
- Maintain detailed documentation of your work and changes to ensure data quality and data management.
- Ensure high operational productivity and quality of your solutions to meet SLAs and support our clients (Data Science, Data Analysis groups).
- Be an active participant and supporter of agile/scrum practice to ensure safety and cycle enhancements for your team.
Essential Qualifications:
- Solid SQL skills and ability to write queries to extract data and build performant datasets.
- Experience with distributed systems like Hadoop (HDFS, Hive, Voila, PySpark) to query and process data.
- Solid programming skills in Python, Java/Scala.
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Large Query).
- Strong involvement in data integration toolsets (i.e. Wind current) and writing and maintaining Data Pipelines.
- Solid knowledge of Data Modeling strategies and Data Warehousing standard systems and practices.
- Familiarity with Scrum and Agile approaches.
Preferred Qualifications:
- Experience with Cloud technologies like AWS (S3, EMR, EC2).
- Strong problem-solving skills with excellent analytical and relational abilities.