-
›
- Careers ›
- Careers in America ›
-
Technical lead
Job Description
Technical lead
Job Summary
-
Location: Georgia
-
Project role: Technical lead
-
Skills: Python
-
No. of positions: 1
Job description:
"Data Engineer
Skillset required for Gen AI Data Engineer:
Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks.
Ability to preprocess and clean large datasets efficiently using Azure Tools Python and other data manipulation tools. Experience with techniques such as data normalization, feature engineering, and data augmentation is preferred.
Expertise in working with sensitive data and data masking techniques to mask personally identifiable information (PII) and protected health information (PHI) is essential.
In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks. Familiarity with search platforms like Elasticsearch or Azure AI Search is a must.
Familiarity with chunking techniques and working with vectors and vector databases like Pinecone.
Ability to design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
Experience with implementing best practices for data storage, retrieval, and access control to ensure data integrity, security, and compliance with regulatory requirements.
Be able to implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
Ability to proactively identify and address issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
Experience with large language model frameworks, such as Langchain and know how to integrate them into data pipelines for natural language processing tasks.
Knowledge of cloud computing principles and experience in deploying, scaling, and monitoring AI solutions on cloud platforms like Azure, AWS.
Ability to communicate complex technical concepts effectively and collaborate with cross-functional teams.
Analytical mindset with a keen attention to detail, coupled with the ability to solve complex problems efficiently.
Previous experience working with Snowflake
"
Disclaimer
HCL is an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law. Should any applicant have concerns about discrimination in the hiring process, they should provide a detailed report of those concerns to secure@hcl.com for investigation.