Data Engineer
Focus GTS
This job is no longer accepting applications
See open jobs at Focus GTS.See open jobs similar to "Data Engineer" Refresh Miami.Software Engineering, Data Science
Fort Lauderdale, FL, USA
Posted on Jul 16, 2024
We are seeking a talented Data Engineer for an exciting opportunity with an Enterprise level company in sunny South Florida. The ideal candidate will possess some, or all, of the qualifications below.
Essential Duties and Responsibilities:
- Create and maintain technical design documentation.
- Conduct requirements gathering, data mapping and designing.
- Create, build, and maintain complex data pipelines from disparate sources that meet functional / non-functional business requirements.
- Create, maintain, and refine existing ETL/ELT processes, employing a variety of data integration and data preparation tools.
- Develop event-based, real-time, and micro-batch data pipelines.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing pipelines for greater scalability, etc.
- Work with stakeholders including Product, Data and Business teams to assist with data-related technical issues and support their data needs.
- Create datasets for: (1) operational reports, key performance indicators/metrics, or other insights into current organizational activities, (2) analytics and data science to provide the ability to uncover the answers to major questions that help organizations make objective decisions and/or gain a competitive edge.
- Write, debug, and implement complex queries involving multiple tables or databases across platform(s)
Qualifications, Knowledge and Skills:
- 3+ years of experience with Python, SQL, and Command Line Interfaces.
- 3+ years of experience with streaming technologies (Kafka, Pubsub, Kinesis) and log-based architectures and experience writing batch and stream processing jobs (i.e. Apache Beam, Google Cloud DataFlow, Apache Spark, Apache Storm).
- 3+ years of experience working and creating datasets for a data warehouse.
- Clear understanding of data modeling patterns.
- 3+ years of experience with ETL/ELT development tools (Azure Data Factory (ADF) preferred).
- 3+ years of experience with code version control using tools, such as Git, and experience with Agile tools (Jira or Azure DevOps preferred).
- 3+ years of cloud experience (Azure preferred).
- Experienced in using best practices in designing, building and managing data pipelines that require data transformations as well as metadata and workload management.
- Experienced in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional and new data integration technologies (such as ETL, ELT, data replication, change data captures, message-oriented data movement, API design, stream data integration and data virtualization)
- Experienced with implementing data quality frameworks.
- Expert level knowledge with programming languages including Python, SQL, CLI.
- Expert level knowledge with relational SQL databases such as Oracle and SQL Server.
Huge PLUSES
- Experience with ERP systems
- Experience with NoSQL databases
- Knowledge of the hospitality industry
This job is no longer accepting applications
See open jobs at Focus GTS.See open jobs similar to "Data Engineer" Refresh Miami.