Description
CTG is seeking to fill a Data Engineer opening for our client in Manassas, VA.
Location: Manassas, VA (1 day per week Onsite)
Duration: Permanent Placement
USC/GC Only
Overview:
We are seeking a Data Engineer for our growing data analytics practice. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal individual must have experience in data integration across multiple applications. He or she should also have experience in designing and developing ETL for data warehouse/data lakes. The Data Engineer will support our software developers, database architects, data analysts and data scientists on a variety of initiatives and will ensure optimal data delivery architecture being consistent throughout ongoing projects.
This position must work and think independently; duties of this position are to be completed under minimal guidance. Discretion in handling assigned responsibilities, including the ability to resolve problems and exercise good judgment while maintaining confidentiality. Functions are to be completed in a timely manner with acceptable quality.
Duties:
Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build data pipeline frameworks to automate high-volume and real-time data delivery to our cloud platform.
Design and develop ETL solutions to move data from any source (relational, API, non-relational) to data warehouse/delta lakes.
Have thorough knowledge of Data warehousing designs and have experience in designing conceptual and logical data models and flowcharts.
Ability to write and maintain Spark and Python notebook in Azure for data integration and analysis.
Apply modern cloud data modeling techniques to ensure development and implementation support efforts meet integration and performance expectations.
Ability to Independently analyze data, solve, and correct issues in real time, providing problem resolution end-to-end.
Coordinate with other IT teams and Client departments to identify future needs and requirements.
Refine and automate regular processes, track issues, and document changes.
Design, develop and maintain data services and/or pipelines as part of an Agile/Scrum team.
Work with program management and engineers to implement and document complex and evolving requirements.
Assist developers with complex query tuning and schema refinement.
Share domain and technical expertise, providing technical mentorship and cross-training to other peers and team members.
Perform multiple tasks simultaneously and successfully perform under changing requirements and deadlines.
Minimum Qualifications and Requirements:
Bachelor's degree or equivalent experience and a minimum of eight (8) years' experience in designing and developing data integration solutions.
Expertise in SQL and Data warehousing concepts. Experience with modern cloud databases and services in Azure environment. This should include working with Azure synapse environment and also have knowledge of NoSQL databases specially Cosmos.
Experience in designing and implementing ETL in Azure data integration tools (Azure data factory, Azure synapse pipelines, Spark notebooks).
Experience in working on Delta Lake in Azure of data bricks environment and worked in implementing delta lake earlier.
Knowledge to manage huge amounts on unstructured data from devices.
Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools.
Leverage DevOps tool stack to build, inspect, deploy, test and promote new or updated features.
Experience with reporting (e.g. SSRS, Business Objects, Cognos etc.) and data visualization tools (e.g. Power BI, Tableau)
Self-starter, motivated and takes initiative; strong interpersonal and problem-solving skills; able to work collaboratively with all levels of staff to resolve problems to maximize performance, creativity, problem solving and results.
Seek, learn, and apply new skills/knowledge to perform job responsibilities.
Attentive to detail with a high level of accuracy; exercise sound judgment.
Resourceful, diplomatic, and professional; deliver outstanding customer service while managing relationships; a can-do attitude and work style that supports teamwork, collaboration and positive relationships.
Adaptable; be able to shift priorities and focus as departmental and/or business demands change (including, but not limited to early/late hours and/or weekend hours).
Strong analytical skills and organized; completes tasks ahead of schedule.
Excellent written and verbal communication skills, including excellent listening skills to communicate clearly, concisely and effectively.
Position-relevant computer experience including Microsoft Office.
Follow all company safety practices, Standard Operating Procedures (SOP's) and policies.
Preferred Qualifications:
Experience working with or for Federal Contractors.
Experience in Manufacturing.
Physical Demands:
Hearing and speech sufficient to verbally communicate in person and on the telephone constantly (66-100%).
Mobility to constantly (66-100%) alternate between sitting, standing, walking, crouching, kneeling, etc. as required to perform job responsibilities.
Work Conditions:
Typical office environment; no negative conditions.
Occasional domestic travel (
Other Duties:
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.
To Apply:
To be considered, please apply directly to this requisition using the link provided . For additional information, please contact Anisha Muralidhar at 716-887-7411 or Anisha.Muralidhar@ctg.com . Kindly forward this to any other interested parties. Thank you!
About Us
CTG, a Cegeka company, is at the forefront of digital transformation, providing IT and business solutions that accelerate project momentum and deliver desired value. Over nearly 60 years, we have earned a reputation as a faster and more reliable, results-driven partner. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. CTG leverages the expertise of over 9,000 team members in 19 countries to provide innovative solutions. Together, we operate across the Americas, Europe, and India, working in close cooperation with over 3,000 clients in many of today's highest-growth industries. For more information, visit www.ctg.com .
Our culture is a direct result of the people who work at CTG, the values we hold, and the actions we take. In other words, our people define our culture. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. Part of our mission is to cultivate a workplace that attracts and develops the best people, reflected by our recognition as a Great Place to Work CertifiedTM company across many of our global operations.
CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity and Affirmative Action Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. Our Affirmative Action program serves to promote occupational equality and diversity through good faith efforts. CTG is fully committed to promoting employment opportunities for members of protected classes.
Submit a referral to this job (https://usjobs-ctg.icims.com/jobs/10876/data-engineer/job?mode=apply&apply=yes&in_iframe=1&hashed=-1834384795)
ID 2024-10876
Title Data Engineer
Location US-VA-Manassas
