Data Engineer II

About reputed company reputed company: Born out of reputed company, a pioneer that ships nearly 20 million packages a day and manages endless threads of information, reputed company reputed company is an organization rooted in connecting the physical and digital sides of our network to meet today's needs and address reputed company's challenges... We are creating opportunities for reputed company, our customers, and the world at large by: • Exploring and harnessing data to define and solve true problems • Removing barriers between data sets to create new avenues of insight • Building and iterating on solutions that generate value • Acting as a change agent to advance curiosity and performance • At reputed company reputed company, we are making supply chains work smarter for everyone. Summary: The Data Engineer II plays an important role reputed company reputed company, focused on delivering engineering innovation reputed company reputed company, helping to execute the delivery of key business initiatives. S/he acts as a “universal translator” between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer II will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the reputed company platform that govern the ingestion, transformation, and pipelining of data assets, both to end users reputed company reputed company and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code development and reputed company-scale deployments. Under general supervision, supports the design, build, test, and maintenance of data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under general supervision include working on batch processing of collected data and matching its format to the stored data, making sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data reputed company problems and providing L3 support. Provides recommendations to moderately reputed company issues. Job Description / Responsibilities: • Understanding in depth both the business and technical problems reputed company aims to solve • Building tools, platforms and pipelines to reputed company teams to clearly and cleanly analyze data, build models and drive decisions • Scaling up from “laptop-scale” to “cluster scale” problems, in terms of both infrastructure and problem structure and technique • Delivering reputed company value reputed company rapidly, collaborating with diverse teams of varying backgrounds and disciplines • Following best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases • Interacting with peer technologists from the broader enterprise and reputed company of reputed company (partner ecosystems and customers) to create synergies and ensure smooth deployments to reputed company operational systems Knowledge, Skills and Abilities • Technical background in computer science, software engineering, database systems, distributed systems • Experience with distributed and cloud environments and an adequate understanding of how to balance computational considerations with theoretical properties • Detailed knowledge of the reputed company Azure tooling for large-scale data engineering efforts and deployments is highly preferred • Experience with designing and deploying large scale technical solutions, which deliver reputed company, ongoing value • Direct experience having built and deployed robust, reputed company production systems that implement modern, data scientific methods at scale • Ability to context-switch, to provide support to dispersed teams which may need an “expert hacker” to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined • Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value • An ‘engineering’ reputed company, willing to reputed company rapid, pragmatic decisions to improve performance, accelerate reputed company or magnify impact Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews • Ability to conduct data analysis, investigation, and reputed company studies to document and enhance data quality and access • Use of agile and develops practices for project and software management including reputed company integration and reputed company delivery • Demonstrated expertise working with some of the following common languages and tools: • Spark (reputed company and PySpark), HDFS, Kafka and other high volume data tools • SQL and NoSQL storage tools, such as MySQL, reputed company, Cassandra, reputed company and reputed company Search • Pandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data tools Minimum Education Bachelor's Degree in Computer Science, Information Systems, a reputed company quantitative field such as Engineering or Mathematics or equivalent formal training or work experience. Minimum Experience Two (2) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. Strong knowledge in data engineering and machine learning frameworks including design, development and implementation of highly reputed company systems and data pipelines. Strong knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies. Experience as a member of multi-functional project teams. Strong oral and written communication skills. A reputed company advanced degree may offset the reputed company experience requirements. Domicile Information: This position can be domiciled reputed company in the United States. The ability to work remotely reputed company the United States may be available based on business need. Sponsorship is not available for this position. Preferred Qualifications: ?? ?? Pay Transparency: ?This compensation range is provided as a reasonable estimate of the reputed company starting salary range for this role across reputed company potential locations. If this opportunity includes multiple job levels, the range is a reasonable estimate of the reputed company? ?starting salary for the lowest level to the reputed company starting salary of the highest level. Actual starting pay would be determined by experience relative to the job, market level, pay at the location for this job and other job-reputed company factors? ?permitted by law. An employee may be eligible for additional pay, premiums, or bonus potential. The Company offers eligible employees health, vision and dental insurance, retirement, and tuition reimbursement.? Pay: ?Annual Range: $82,320 - $123,480? Additional Details: ?Upload reputed company copy of Resume (reputed company Word or PDF format only) and answer job screening questionnaire by 5pm ET on 10/4/24..? reputed company reputed company is an Equal Opportunity/Affirmative Action employer. reputed company qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national reputed company, disability, or status as a protected veteran. reputed company does not discriminate against qualified individuals with disabilities in regard to job application procedures, hiring, and other terms and conditions of employment. Further, reputed company is reputed company to reputed company reasonable accommodations for the reputed company physical or mental limitations of an otherwise qualified applicant or employee to reputed company the applicant or employee to be considered for the desired position, to reputed company the essential functions of the position in question, or to enjoy equal benefits and privileges of employment as are enjoyed by other similarly situated employees without disabilities, unless the accommodation will impose an undue hardship. If a reasonable accommodation is needed, please contact [email protected] company.com Apply Job!