Lead Data Engineer
- Country: United States
- Region: South Carolina
Position- Lead Data Engineer with Azure
Location- New Jersey / Fort Mill, South Carolina/Day 1 onsite
Skills:
Over all 12 to 15 years of experience with Data Management, Data
Warehousing and Analytics.
At least 4 to 5 years of experience in Architecting and Implementing Data
Solutions.
At least 3 years of experience in implementing the data solutions on MS
Azure using Azure Data Factory, MS Synapse.
One to two years of experience in Azure Synapse Analytics is plus.
Installing and configuring ADF integration runtimes and linked services.
At least one hands on experience with Big data platform tool selection POC.
Two years of experience in data migrations to Azure by using data box or
Data migration Services.
Apache Spark experience using Scala or PySpark or pre-packaged tools like
Databrick is must.
Extensive hands-on experience in data warehousing design, tuning and
ETL/ELT process development by using cloud native technologies.
At least one year experience with unified data governance solution using MS
Purview.
Developing the CICD pipeline for Azure Infrastructure, version control
strategy and Integrate source control ( Azure repos)
In-depth understanding of various storage services offered by Azure.
Experience with implementation of data security, encryption, PII/PSI
legislation, identity and access management across sources and environments.
Experience with data process Orchestration, end-to-end design and build
process of Near-Real Time and Batch Data Pipelines.
Reference : Lead Data Engineer jobs