c2c hiring
Role : Sr. Azure Databricks Engineer
Location: Dallas, TX
Client : FORTRESS INVESTMENT GROUP
Duration: 12 Months
MOI : Telephonic & F2F
Primary Skills: Azure Databricks, SQL, PostgreSQL
This is a C2C role and needs H1B, GC & US. Citizens with a Minimum of 15 Years of Experience. This is an Onsite/Hybrid Model and we Need Locals or within 50-mile radius. Relocation Candidates will not be considered.
Candidates must have Strong Investment Banking Experience.
Mode of Interview: Telephonic & F2F.
MUST HAVE EXPERTISE IN THE SKILLS GIVEN BELOW:
Azure Functions
SQL Server
PostgreSQL
Databricks
Strong background in Data Quality
RESPONSIBILITIES:
Build large-scale batch and real-time data pipelines with data processing frameworks on the Azure cloud platform.
Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks.
Direct experience of building data pipelines using Azure Data Factory and Databricks.
Developing scalable and reusable frameworks for ingesting datasets
Lead design of ETL, data integration, and data migration.
Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise-grade platforms that enable data-driven solutions.
Integrating the end-to-end data pipeline – to take data from source systems to target data repositories, ensuring the quality and consistency of data is maintained at all times.
Working with event-based / streaming technologies to ingest and process data
Working with other members of the project team to support the delivery of additional project components (API interfaces, Search)
Evaluating the performance and applicability of multiple tools against customer requirements
REQUIREMENTS:
Experience on ADLS, Azure Databricks, Azure SQL DB, and Data Warehouse
Strong working experience in the Implementation of Azure cloud components using Azure Data Factory, Azure Data Analytics, Azure Data Lake, Azure Data Catalogue, Logic Apps, and Function App.s Known Azure Storage services (ADLS, Storage Accounts)
Expertise in designing and deploying data applications on cloud solutions on Azure
Hands-on experience in performance tuning and optimizing code running in the Databricks environment
Good understanding of SQL, T-SQL, and/or PL/SQL
Should have experience working in Agile projects with knowledge of Jira
Good to have handled Data Ingestion projects in the Azure environment
Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
Experience in Python scripting, Spark SQL, and PySpark is a MUST
Regards,
To apply for this job email your details to mady@sunrayinformatics.com