Data Engineer

The Data Engineer will be responsible for developing semantic models on top of the Data Lake/Data Warehouse to fulfill the self-service BI foundation requirements. This includes data extraction from various data sources and integration into the central data lake/data warehouse using enterprise platforms like Informatica iPaaS.Key Responsibilities of Data EngineerDesigning data warehouse data models based on business requirements.Designing, developing, and testing both batch and real-time Extract, Transform and Load (ETL) processes required for data integration.Ingesting both structured and unstructured data into the SMBU data lake/data warehouse system.Designing and developing semantic models/self-service cubes.Performing BI administration and access management to ensure access and reports are properly governed.Performing unit testing and data validation to ensure business UAT is successful.Performing ad-hoc data analysis and presenting results in a clear manner.Assessing data quality of the source systems and proposing enhancements to achieve a satisfactory level of data accuracy.Optimizing ETL processes to ensure execution time meets requirements.Maintaining and architecting ETL pipelines to ensure data is loaded on time on a regular basis.Qualification Required for Data Engineer5 to 8 years of overall experience.Proven experience in the development of dimensional models in Azure Synapse with strong SQL knowledge.Minimum of 3 years working as a Data Engineer in the Azure ecosystem specifically using Synapse, ADF & Data bricks.Preferably 3 years of experience with data warehousing, ETL development, SQL Queries, Synapse, ADF, PySpark, and Informatica iPaaS for data ingestion & data modeling.#J-18808-Ljbffr