Data Engineer

Job Description

Share on:FacebookX

Data Engineer Job Description

 

Job Title: Data Engineer

 

Job Summary:

We are seeking a skilled and experienced Data Engineer to design, build, and maintain scalable data infrastructure and systems. The Data Engineer will be responsible for collecting, storing, and processing large volumes of data from various sources, and transforming it into formats that can be easily analyzed and used by data scientists, analysts, and business users.

 

Responsibilities:

 

     Design and develop scalable data architectures and systems that can handle large volumes of data and support real-time processing and analytics

     Collect, extract, transform, and load data from various sources, including databases, data warehouses, and data lakes

     Ensure data quality and integrity through the use of validation and cleansing processes, and implement data security and privacy measures

     Collaborate with data scientists, analysts, and business users to understand their data needs and requirements, and provide them with access to the data they need

     Develop and maintain ETL processes, data pipelines, and other data integration tools and technologies

     Perform data modelling and database design, and optimize data structures and queries for performance and scalability

     Monitor and maintain data infrastructure and systems to ensure they are operating at peak performance and availability

     Stay up-to-date with new and emerging technologies and techniques in the data engineering field, and recommend new tools and technologies as needed

     Participate in team meetings, code reviews, and other collaborative activities to ensure the successful development and implementation of data infrastructure and systems

 

Requirements:

 

     Bachelor's degree in Computer Science, Electrical Engineering, or related field (required), Master's degree in Computer Science or related field (preferred)

     Minimum of 5 years of experience in data engineering, with a focus on data architecture and systems development

     Strong knowledge of data management and database technologies, such as SQL, NoSQL, Hadoop, and Spark

     Experience with data integration tools and technologies, such as ETL, data pipelines, and data warehousing

     Excellent programming skills in languages such as Python, Java, and/or Scala

     Strong analytical and problem-solving skills, with the ability to analyze complex data and identify solutions to data engineering challenges

     Strong communication and interpersonal skills, with the ability to work effectively in a team environment

     Ability to manage multiple projects and priorities, and to adapt quickly to changing situations

     Commitment to maintaining confidentiality and integrity in all aspects of the job, and to promoting a safe and inclusive work environment.