Senior Data Engineer

Description

The role is Senior Data Engineer, based at 811 Excellence Dr., Bentonville, AR 72716.

The posting does not describe the company's stage or team beyond the job itself.

Responsibilities

• Guide less experienced programmers and set up support for system troubleshooting.
• Connect data strategy to business value, covering data quality standards, governance, accessibility, storage, scalability, and ways data can produce money.
• Apply the defined strategy to routine business problems that affect a single function.
• Find the right data sources by working through business domains, data categories, storage locations, SQL and NoSQL databases, business rules, and success measures.
• Help rank requirements and service level agreements, choose the best source for fit-for-purpose data, and run first-pass quality checks on extracted data.
• Build transformation and integration work across internal and external sources, using ETL batch jobs, streaming ingestion, scrapers, APIs, and crawlers.
• Work with warehousing services for structured and semi-structured data and MPP databases such as Snowflake, Microsoft Azure, Presto, or Google BigQuery.
• Apply preprocessing (transformation, integration, normalization, feature extraction) and analytics methods such as decision trees, LASSO regression, advanced regression, and random forests.
• Work in cloud and big data environments such as EDO2 systems.
• Pull data from identified databases, build pipelines, and reshape it into structures suited to each problem.
• Keep up with current data science and analytics trends.
• Frame technical problems around analytics, big data, automation, business needs, priorities, and use cases.
• Design conceptual, logical, and physical data models, including warehouse and data mart designs, using dimensional design, ER diagrams, and Erwin.
• Define relational tables, primary and foreign keys, and stored procedures to build model structures.
• Review existing data models and physical databases for variances and discrepancies, and build efficient data flows.
• Analyze data integration problems between systems and propose fixes.
• Write training documents and teach end users about data modeling.
• Work with cloud data strategy, data lakes, enterprise big data platforms, automated data loads, and AI-enabled metadata tools.

Requirements

• Master's degree or equivalent in Computer Science or a related field, plus 1 year of experience in software engineering, data engineering, database engineering, business intelligence, business analytics, or a related field.
• Or a Bachelor's degree or equivalent in Computer Science or a related field, plus 3 years of experience in the same fields.
• Experience building applications with Apache Spark.
• Experience with Hadoop ecosystem components: Hadoop, HDFS, YARN, TEZ, and MapReduce.
• Experience writing Unix shell scripts.
• Experience scheduling production jobs with Apache Airflow and Oozie.
• Experience running applications on clusters and managing data on Google Cloud Platform.
• Experience writing Hive applications in HiveQL.
• Experience with Maven and SBT for deployment.
• Experience building CI/CD pipelines with Jenkins and using Git for source control.
• Experience with Agile work in sprints, using story points in JIRA and Scrum.
• Experience with project management across initiation, planning, execution, monitoring and control, and closure.
• Experience gathering requirements from several teams for project increment planning.
• The employer will accept any amount of experience with these skills.

Conditions

Pay is $90,000.00 to 180,000.00 per year, plus annual or quarterly performance incentives.

Eligibility for some benefits depends on job classification and length of employment, and benefits may change or follow specific plan terms.

The company is an Equal Opportunity Employer.

The company runs a drug-free workplace with a zero-tolerance policy on illegal drugs and alcohol on the job.

Benefits

• Competitive pay, performance-based incentive awards, and other benefits.
• Health coverage: medical, vision, and dental.
• Financial benefits: 401(k), stock purchase, and company-paid life insurance.
• Paid time off: PTO including sick leave, parental leave, family care leave, bereavement, jury duty, and voting.
• Other benefits: short-term and long-term disability, education assistance with 100% company-paid college degrees, company discounts, military service pay, and adoption expense reimbursement.