Airbnb is a mission-driven company dedicated to helping create a world where anyone can belong anywhere. It takes a unified team committed to our core values to achieve this goal. Airbnb’s various functions embody the company’s innovative spirit and our fast-moving team is committed to leading as a 21st century company. What is Data Engineering at Airbnb? We need to ensure every area of the… business has trustworthy data to fuel insight and innovation. Understanding the business need, securing the right data sources, designing usable data models, and building robust & dependable data pipelines are essential skills to meet this goal. At the same time, the technology used to create great data is continually evolving. We are moving to a reality where both batch & stream processing are leveraged to meet the latency requirements for the business. The Data Engineering paved path is still taking shape, and we want to collaboratively develop this to support the entire company. We need senior engineers who are passionate not only about the data, but also about improving the technology we leverage for Data Engineering. We are looking for talented senior Data Engineers who are excited about redefining what it means to do Data Engineering. Data Engineering is part of our Engineering org as we believe great Data Engineering depends on solid Software Engineering fundamentals. However, we also recognize that each Data Engineer has a unique blend of skills. Whether your strength is in data modeling or in stream processing, we want to talk to you. The Community Support Platform (CSP) organization is building a technology platform that supports Airbnb as it scales, delivering exceptional customer service while also improving efficiency and the customer service agent experience. Our customers can reach out to Airbnb through various channels like Phone, Messaging, LiveChat, Email and Social channels to get support from Airbnb Support Ambassadors. Based on data from these channels, we generate metrics and reportings to track the performance of our community support. Data plays a major role in this vision. We are hiring for an experienced data engineer who can work effectively in the cross functional Data Platform team by partnering with stakeholders (Data Scientists, ML Engineers, Data Analysts and Product teams) to understand the pain points, build generic long term solutions and be capable of evangelizing the solution to a broader Data Engineering organization and contributing to the Data Engineering paved path for Airbnb. We are looking for senior engineers who are passionate not only about the data, but also about improving the technology we leverage for Data Engineering. What you may work on:
Modernize our tech stack and improve data quality by moving our data processing to testable pipelines in Scala Spark, define schema/data contracts with upstream sources and detect data problems before our users do. Define logging, processing, validation, storage, aggregation and anonymization for agent and customer data to power analytics, reporting (e.g. to pay out Airbnb ambassadors across the globe, measure quality of our customer support and customer satisfaction, etc.), product experimentation and ML models. Existing data reporting is fragmented because routing and channel management are dispersed across homegrown systems and bought systems, and thus it’s difficult to assemble a holistic view of agent performance and channel performance from a global and site level. This year the CS Platform team kicked off the Quantum Leap program which will update and overhaul almost every aspect of our customer service experience. We are re-architecting data pipelines and building new data models to support Case and other important business entities. This provides a rare opportunity to understand the business bottoms up. There will be a significant Data integration effort required to ingest data from third party vendors and to export Airbnb data to external vendor systems. This is an opportunity to be part of creating a generic platform for external data ingestion, supporting streaming and batch. Real time data infrastructure will be critical to the new architecture. You will be part of creating near real time data processing capabilities using Apache Flink and generate business insights in real time. Work with the consumer ML team on delivering data for training purposes, identify gaps in existing architecture and onboard the data to Airbnb’s feature store for online consumption and scoring purposes. Some example projects the team has shipped in the past:
horizontal offline data models to power tier 2 metrics (phone abandon rate and wait time, contact rate, time to resolution, customer satisfaction, etc.) a streaming framework for stateful computation and real-time joins from a set of Kafka events based on full change history configuration based orchestration and ingestion from S3 to Hive to support integrations with our third party data providers a near real time system for collecting feedback from customers who contacted Airbnb’s community support and subsequently had their support ticket solved
Responsibilities:
Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Airbnb business growth and improve the product experience. Build scalable Spark data pipelines leveraging Airflow scheduler/executor framework Design our data models for optimal storage and retrieval and to meet critical product and business requirements. Understand and influence logging to support our data flow, architecting logging best practices where needed Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company Improve data quality by using & improving internal tools to automatically detect issues Minimum Requirements:
5
years of relevant industry experience Bachelor’s and/or Master’s degree, preferably in CS, or equivalent experience Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions Experience designing and deploying high performance systems with reliable monitoring and logging practices Working knowledge of relational databases and query authoring (SQL). Excellent communication skills, both written and verbal Interesting reads:
Data Quality at Airbnb. Part 1 – Rebuilding at Scale by Jonathan Parks Airbnb Engineering & Data Science Data Quality at Airbnb. Part 2 – A New Gold Standard by Vaughn Quoss Airbnb Engineering & Data Science How Airbnb Achieved Metric Consistency at Scale by Robert Chang Airbnb Engineering & Data Science Apr, 2021
Salary Range:
$80K — $100K
Minimum Qualification
Technical Support, Data Science & Machine LearningEstimated Salary: $20 to $28 per hour based on qualifications
For more such jobs please click here
