AI Engineer (LLM/Python/Golang)

About usBitcoin Builders is a leading company in Blockchain and Artificial Intelligence (AI). We create innovative solutions that combine Blockchain and AI to improve processes and user experiences. We are looking for an talented AI Engineer for our products. Role SummaryYou will design, build, and operate a fully distributed, peer‑to‑peer (P2P) infrastructure in which every node can host a large‑language‑model (LLM) and expose real‑time inference APIs to users. Your mission is to make the network self‑orchestrating, fault‑tolerant, secure, and cost‑efficient while delivering low‑latency, high‑throughput model serving at scale. Key Responsibilities Architecture & Design Define the overall P2P topology, discovery, and routing protocols.Partition/model‑sharding strategies (tensor, expert & pipeline) to fit heterogeneous devices. Establish secure, trust‑minimized mechanisms for node onboarding, reputation, and payment/credit settlement. Model Serving & Optimization  Package and serve multiple LLM checkpoints (open‑source and custom) across CPU, GPU, and accelerator back‑ends. Implement quantization, speculative decoding, KV‑cache offloading, and other inference‑speed techniques. Monitor latency, token‑throughput, and memory footprint; drive continuous optimisation.Distributed Systems Engineering  Build gossip‑based or DHT‑based neighbor discovery; maintain consistency of model versions across the swarm. Design streaming and chunked transport layers to support long-context or streaming‑generation workloads. Handle churn gracefully (node joins/leaves, flaky devices, NAT traversal, intermittent connectivity).