Specialist - Data Engineering

Role description

Job Title: Data Bricks developer

Work Location : Tampa, Florida

Job Description:

• Seeking a Specialist with 7 to 9 years of experience in Scala Spark and Databricks to design develop and optimize scalable data solutions leveraging Azure Data Factory ADF
• Design and develop scalable and efficient data pipelines using Databricks Spark Scala and Azure Data Factory ADF to support business analytics and reporting needs Collaborate with crossfunctional teams including data engineers analysts and business stakeholders to gather and translate data requirements Ensure data quality consistency and governance across multiple data sources and cloud environments Stay updated with emerging trends and best practices in Databricks Spark Scala and Azure Data Factory to drive innovation in data processing workflows Participate in technical discussions and contribute to architectural decisions related to data integration and transformation solutions

Roles and Responsibilities

• Develop and implement robust ETLELT processes using Scala Spark Databricks and Azure Data Factory for data ingestion transformation and preparation Monitor troubleshoot and resolve data pipeline issues to ensure reliable and uninterrupted data flow Analyze existing data architectures and recommend improvements to enhance scalability performance and efficiency Document data workflows pipeline configurations and technical specifications to facilitate knowledge sharing and maintenance Drive best practices in data governance security compliance and data modeling Mentor and guide junior team members to promote continuous learning and skill development