Big Data Engineer - Austin
Austin,Texas,United States
Software and Services
5+ years of professional experience with Big Data systems, data pipelines and data processing
Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark
Ability to understand API Specs, identify relevant API calls , extract data and implement data pipelines & SQL friendly data structures
Understanding on various distributed file formats such as Apache AVRO, Apache Parquet and common methods in data transformation
Expertise in Python, Unix Shell scripting and Dependency driven job schedulers
Expertise in Core JAVA, Oracle, Teradata and ANSI SQL
Knowledge on Scala and Splunk is a plus
Familiarity with rule based tools and APIs for multi stage data correlation on large data sets
Description
Translate business requirements by business team into data and engineering specifications Build scalable data sets based on engineering specifications from the available raw data and derive business metrics/insights Work with engineering and business partners to define and implement the data engagement relationships required with partners Understand and Identify server APIs that needs to be instrumented for data reporting and analytics and align the server events for execution in already established data pipelines Explore and understand complex data sets, identify and formulate correlational rules between heterogenous data sources for effective analytics and reporting Process, clean and validate the integrity of data used for analysis Develop Python and Shell Scripts for data ingestion from external data sources for business insights
Education & Experience
Minimum of bachelor's degree, preferably in Computer Science, Information Technology or EE, or relevant industry experience is preferred
Additional Requirements
Apple Footer
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant (Opens in a new window) .
Apple will not discriminate or retaliate against applicants who inquire about, disclose, or discuss their compensation or that of other applicants. United States Department of Labor. Learn more (Opens in a new window) .
Apple is required to comply with a COVID-19 vaccination mandate issued by the New York City Department of Health. We will verify the vaccination status of all New York City team members who are working at an Apple Store, office, or partner store in New York City. New York City Department of Health Learn more (Opens in a new window) .
Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you're applying for a position in San Francisco, review the San Francisco Fair Chance Ordinance guidelines (opens in a new window) applicable in your area.
Apple participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program (Opens in a new window) .
Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy Learn more (Opens in a new window) .
