Key Responsibilities Include:
- Designing and building scalable data storage solutions: Data engineers design and build data storage systems that can handle large amounts of data, and are scalable, reliable, and secure.
- Data ingestion and processing: Data engineers are responsible for the ingestion of data from various sources, and for processing the data into a usable format for analysis and reporting.
- Data integration: Data engineers integrate data from various sources into a centralized data storage solution, and ensure that the data is consistent, accurate, and up- to-date.
- Data warehousing: Data engineers design and implement data warehousing solutions to support business intelligence and analytics initiatives.
- ETL (Extract, Transform, Load) processes: Data engineers design and implement ETL processes to extract data from various sources, transform it into a usable format, and load it into a centralized data storage solution.
- Data pipeline development: Data engineers design and implement data pipelines to automate the flow of data from various sources to a centralized data storage
solution. - Data quality and governance: Data engineers implement data quality and governance processes to ensure that the data is accurate, consistent, and secure.
- Data security and privacy. Data engineers are responsible for implementing data security and privacy measures to protect sensitive and confidential data.
- Performance optimization: Data engineers are responsible for optimizing the performance of data storage solutions and data processing processes.
- Collaboration with data scientists and business stakeholders: Data engineers work closely with data scientists and business stakeholders to understand their data requirements, and to ensure that the data storage and processing solutions meet their needs.
Qualifications/Criteria:
- HND, Bachelor in Computer Science/Sofware engineering or related discipline
- 1+ years of related experience in data engineering/ software engineering
- Scripting/programming with Python, Scala, etc
- Hands-on experience working with PL/SQL
- Experience in working with realtime data processing tools like NiFi or open source data processing tools such as Talend
- Hands on experience working with large volumes of Data including ETL or ELT process
- Excellent oral and written communication skills
Apply via SpotJobs
Please click APPLY NOW button to upload your CV via SpotJobs