← 中文资源

简体中文版本

构建 gRPC 服务网格客户端

构建 gRPC 服务网格客户端:完整覆盖 inter-service rpc,含 Channel resolver、Load balancer 与测试的端到端实现。

阅读英文原文

项目概述

本项目实现一个面向 inter-service rpc 的完整系统,核心要解决的问题是 adding retry, load balancing, and circuit breaking to gRPC calls without modifying service code。整体由 Channel resolver、Load balancer、Retry policy、Circuit breaker、Intercept chain 五个模块组成,每个模块单一职责、可独立测试,最后通过集成测试验证端到端正确性。设计上把 a retry storm where every upstream is slow and retries multiply load exactly when the system is least able to handle it 作为第一类需求先行处理,而非事后再补。

架构与关键决策

数据模型为 a set of upstream addresses resolved dynamically, with per-method policies applied through client interceptors。Channel resolver 定义其余阶段共同依赖的数据形状并在边界处校验输入;Load balancer 承载 inter-service rpc 的正确性逻辑;Retry policy 专门处理 a retry storm where every upstream is slow and retries multiply load exactly when the system is least able to handle it,在失败路径上给出明确的拒绝、重试或降级策略;Circuit breaker 提供可观测性,每次操作输出带关联 id 的结构化事件;Intercept chain 在过载时按既定方式降级,避免过载演变为数据损坏。配置与代码分离,使风险变更可经 diff 审阅。

实施与测试

按五个阶段依次实现 Channel resolver、Load balancer、Retry policy、Circuit breaker、Intercept chain,每阶段配套聚焦单测。集成测试组合各模块并驱动真实 inter-service rpc 场景:先验证正常路径,再刻意触发 a retry storm where every upstream is slow and retries multiply load exactly when the system is least able to handle it 并断言系统降级而非损坏。所有依赖均在进程内或被桩替换,用例在 CI 中确定可复现。

限制与后续

  • 单区域设计,多区域复制超出范围。
  • Channel resolver 默认进程内,未水平共享。
  • 无鉴权层,假定部署在强制身份的边缘之后。

代码示例

# setup for grpc-service-mesh
pnpm init
pnpm add @grpc/grpc-js nice-grpc
pnpm add -D typescript tsx vitest
grpc_service_mesh/
├── src/index.ts
├── src/channel-resolver.ts
├── src/load-balancer.ts
├── tests/grpc_service_mesh.test.ts
└── package.json
// Channel resolver: inter-service rpc core
export function channelresolver(input: ChannelresolverInput): ChannelresolverResult {
  // Build the channel resolver that anchors inter-service rpc and defines the core data shape.
  return processChannelresolver(input);
}
// Load balancer — handles inter-service rpc Add the load balancer so
export class Loadbalancer {
  constructor(private opts: LoadbalancerOptions) {}
  async run(ctx: Context): Promise<LoadbalancerOutput> {
    return this.execute(ctx);
  }
}
// Retry policy: inter-service rpc stage
export const retrypolicy = (next: Next) => async (req: Request) => {
  const out = await transform(req);
  return next(out);
};
// Circuit breaker for inter-service rpc
export async function circuitbreaker(stream: AsyncIterable<Chunk>): Promise<Aggregate> {
  let acc = init();
  for await (const c of stream) acc = merge(acc, c);
  return acc;
}
// Intercept chain: inter-service rpc finalization
export function interceptchain(state: State): Result {
  validate(state);
  return finalize(state);
}
# run the inter-service rpc test suite
pnpm vitest run