Data Engineer
Job Description
Responsibilities
- Provision all cloud infrastructure via Terraform: object storage, vector databases, event streaming, Kubernetes, time-series databases, authentication. All reproducible for new tenants.
- Design multi-tenant storage: shared vector indices for public data, per-tenant indices for proprietary data. Row-level security or schema-level isolation.
- Design per-tenant storage structure with bucket policies enforcing isolation.
- Build market data storage pipeline: exchange feeds → event bus → time-series database.
- Build monitoring dashboards for data pipeline health across all data sources.
- Design feedback data storage: per-tenant schema for feedback events and training data candidates.
- Build data archival pipelines for cost-efficient long-term storage.
- Automate tenant provisioning: a script that creates a new tenant’s storage, network policies, and service accounts.
Requirements
- 4+ years data engineering; strong SQL, Python, and cloud infrastructure.
- Experience designing multi-tenant data architectures with isolation requirements.
- Infrastructure as Code: Terraform or Pulumi — mandatory.
- PostgreSQL experience (vector extensions, partitioning, row-level security a plus).
- Kafka consumer/producer development.
- Time-series data storage and querying experience.
Nice to have
- Experience with financial data: time-series, tick data, on-chain events.
- Understanding of data sovereignty and compliance requirements.
- Experience with tenant provisioning automation.
- Blockchain or crypto data pipeline experience.
About us
彼特思方舟 is a specialized service provider dedicated to delivering a full spectrum of front-office and back-office support solutions, each of which are tailored to the unique needs of global financial technology firms. 彼特思方舟 is engaged by BTSE Group to offer several key positions, enabling the delivery of cutting-edge technology and tailored solutions that meet the evolving demands of the fintech industry in a competitive global market.
BTSE Group is a leading global fintech and blockchain company that is committed to building innovative technology and infrastructure. BTSE empowers businesses and corporate clients with the advanced tools they need to excel in a rapidly evolving and competitive market. BTSE has pioneered numerous trading technologies that have been widely adopted across the industry, setting new benchmarks for innovation, performance, and security in fintech. BTSE’s diverse business lines serve both retail (B2C) customers and institutional (B2B) clients, enabling them to launch, operate, and scale fintech businesses. BTSE is seeking ambitious, motivated professionals to join our B2C and B2B teams.
彼特思方舟是一家專業服務供應商，致力於提供全方位的前台和後台支援解決方案，每個解決方案都是根據全球金融科技公司的獨特需求量身定制的。 彼特思方舟受 BTSE 集團聘用，擔任多個關鍵職位，提供尖端技術和客製化解決方案，滿足競爭激烈的全球市場中金融科技行業不斷變化的需求。
BTSE 集團是一家全球領先的金融科技和區塊鏈公司，致力於打造創新技術和基礎設施。 BTSE 為企業和公司客戶提供在快速發展和競爭激烈的市場中脫穎而出所需的先進工具。 BTSE 率先推出了多項交易技術，並被整個行業廣泛採用，為金融科技的創新、性能和安全樹立了新的標竿。 BTSE 的多元化業務線服務於零售（B2C）客戶和機構（B2B）客戶，使他們能夠啟動、經營和擴展金融科技業務。 BTSE 正在尋找有雄心壯志、有上進心的專業人士加入我們的 B2C 和 B2B 團隊。