Data Engineer

ABOUT THE ROLE

As part of Technology Innovations CoE - supervised by the Engineering Manager & advised by the firm's CTO, you'll also check in with the team daily on the project, collecting information from other products to remain in sync with the entire eco-system in an Agile mindset & strong-Tech Startup environment culture. (Silicon Valley style Tech-startup)

We are creating a comprehensive Cross-border eCommerce Platform that features solutions for Storefront, Payment Gateway, Inventory, Catalog, Logistics, Marketing Insights, CRM... Here are some examples:

- Develop a Storefront solution

- Centralize payment gateways for managing transactions and after-payment business (such as refunds, chargebacks, claims, inquiries,..)

- Integrate various 3rd services to operate a complete supply-chain system, including inventory, catalogs, logistics tracking, and more...

- Convert raw data from marketing campaigns, transactions, user behavior, etc., into insights beneficial and significant for business operations.

- Plus, numerous other opportunities await your input.

In addition to development tasks, collaboration with other firm's CoE is crucial to comprehend issues within their specific sectors. Thus, from a technical standpoint, you will propose solutions to help them improve consistently every day.

WHAT YOU WILL DO

- Participate in Requirements Analysis & Technical Specification in the Agile/Scrum development process.

- Design, develop, and maintain scalable data pipelines and ETL processes to collect, clean, and process large datasets. The system is built on the microservice architecture and deployed Kubernetes (use AWS EKS service) across 3 AWS regions globally (US, HK, SG).

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop data solutions that meet business needs. Use BI tools for data analytics, such as Grafana, AWS QuickSight, or Excel (Google Sheets).

- Develop and implement data integration strategies and data transformation logic, ensuring high-quality and accurate data in the data warehouse. Use Kafka and Nifi tech-stack & eco-system to build data flow.

- Optimize and improve the performance, efficiency, and reliability of data pipelines, data models, and data storage solutions. Use database or object storage services like PostgreSQL, Elasticsearch, Redis, and AWS S3.

- Monitor and troubleshoot data pipeline issues, ensuring data integrity and timely data delivery. Use tools for monitoring logs and issues such as Sentry, Grafana, or alerts Slack.

- Continuously evaluate and implement new technologies, tools, and techniques to enhance data engineering capabilities.

- Document data engineering processes and maintain data dictionaries, ensuring compliance with data governance policies and regulatory requirements. Use the Atlassian toolset (Jira, Confluence) or Slack to help teams organize, collaborate, and complete work together.

WHAT ARE WE LOOKING FOR

- Bachelor's degree in Computer Science or a related field.

- 3+ years of experience in Backend development or Data engineering, ETL development, or a similar role.

- Experience working with microservice architecture.

- Proficiency one of langue in C#, Java, or Python for data processing and scripting.

- Experience working with relational databases, such as one of the database types: PostgreSQL, MySQL, Oracle, or MS SQL Server.

- Knowledge of working with document databases, such as one the database types: Elasticsearch, Redis, MongoDB, or Apache Solr.

- Familiarity with data warehousing concepts and cloud-based data storage solutions (e.g., AWS, GCP, Azure).

- Strong problem-solving skills, attention to detail, and the ability to work independently and as part of a team.

- Excellent communication and collaboration skills, especially in Agile culture environment.

Preferred (but not required)

- Experience with container orchestration, such as AWS EKS or Kubernetes

- Experience with data visualization tools, such as AWS QuickSight or Grafana.

- Experience with databases, and object storage services, such as PostgreSQL, Elasticsearch, Redis, and AWS S3.

- Experience with data streaming platforms, such as Apache Kafka or Apache Nifi.

- Knowledge of data integrated from various sources, such as web services, APIs, and file systems.

- Familiarity with the Agile toolset, such as Gitlab, Jira, Confluence, and Slack.

- English proficiency

WHAT CAN YOU EXPECT

At Crossian, our people are the key to our success. We believe in creating an attractive total compensation package (TCP) that not only retains employees but allows them to excel in their profession. These include:

- A rewarding management role that has direct impact on the organization

- Competitive salary (negotiable depending on what you bring to the table)

- Full salary during probation & Guaranteed 13th month salary

- 12 days work-from-home & 12 days of paid annual leave, plus seniority paid leave

- Global health insurance package for yourself and direct family members, plus annual health checkup

- Quarterly bonus & Year-end bonus as part of our profit sharing program

- A Pantry & a Crossian Cafe stocked with goodies, ready to serve

- Other company benefits including 5-star annual Summer Summit, budget for frequent team building activities and other monthly/ quarterly/ annual company events

- General company T&D Program

- Other benefits in accordance to Company's Policy and Vietnam Labor Laws