Data Engineer

About Karya

Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20 times the local minimum wage. The platform has delivered over 40 million tasks.

About the role

This role runs live client projects on the Karya platform. The work is the execution layer above the core product:
project workflows, data jobs, checks, reports, and delivery.
You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform
engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks
right.

Responsibilities

• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• Configure project workflows, including the handoff from automated processing to human tasks, and track what
is in progress, held, or ready to deliver.
• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.
• Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.
• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• Reply to Operations and client teams with the finding, the change made, and what is still open.
• Report repeated manual work to platform engineering, with an example.

Requirements

• PostgreSQL, including joins, aggregates, and JSON fields.
• Scripts in Python, Bash, or TypeScript, checked into git.
• Ability to read a TypeScript codebase and a relational schema.
• Linux for running jobs: SSH, logs, long-running processes, and disk.
• Ability to write technical updates that give non-technical teammates a clear picture of the situation.
• Queries or scripts already run against real project or production data.

Good to have

• Cloud object storage (Google Cloud Storage, S3, or Azure Blob).
• Experience with collected datasets such as speech, text, or images.
• ClickHouse, Metabase, or a similar reporting tool.

Perks

• Flexible leave, with remote or hybrid work.
• Health insurance.
• Direct work on data collection that determines worker earnings and client deliverables.

Karya is an equal opportunity employer. Applicants are considered without regard to race, religion, gender identity, sexual orientation,
disability, or any other protected status. For accommodations, contact [email protected].