[siso] Precise input verification for dawn generators

To enable safe and correct remote execution (Siso/RBE) for Dawn's
code generators, this CL implements a robust self-verification
system that asserts GN inputs match actual Python dependencies.

Key improvements:
1. Strict Assertion System:
   `generator_lib.py` now accepts `--expected-inputs-file` and
   asserts that the actual dependencies (including imported Python
   modules and templates) match the GN-specified inputs exactly.

2. Glob Pattern Support:
   To handle dynamic dependencies like third-party libraries (Jinja2,
   MarkupSafe) and Git metadata (.git/HEAD), we introduced glob pattern
   matching in the expected inputs (e.g. `*third_party/jinja2/*`).
   The generator uses `fnmatch` to strictly detect missing inputs
   while safely allowing unused, over-specified inputs. Misplaced
   glob patterns are filtered out from Ninja's physical inputs in
   `generator_lib.gni`.

3. Dynamic Argument Construction:
   The `dawn_json_generator` template in `dawn_generator.gni` now
   automatically detects the presence of optional files (like
   `dawn_wire.json` or `dawn_kotlin.json`) in the target's `inputs` using
   `filter_include`, and dynamically appends the corresponding generator
   arguments (e.g., `--wire-json`). This completely eliminates the need to
   hardcode target-to-JSON mappings in both Python and GN sides.

4. Explicit Target inputs:
   All individual generator targets in `BUILD.gn` files now explicitly
   list their required templates and JSON files in their `inputs`,
   ensuring clean and maintainable dependency tracking.

Bug: 466134210
Change-Id: I0155aa259474c8e8b8e8e08861c55fd1fed63c04
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/315915
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Reviewed-by: Brandon Jones <bajones@chromium.org>
Auto-Submit: Takuto Ikuta <tikuta@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
12 files changed
tree: 8f087d968543c1472d28ea9f676c61ea627ce1da
  1. .github/
  2. .vscode/
  3. agents/
  4. build_overrides/
  5. docs/
  6. generator/
  7. include/
  8. infra/
  9. scripts/
  10. src/
  11. test/
  12. third_party/
  13. tools/
  14. webgpu-cts/
  15. .bazelrc
  16. .bazelversion
  17. .clang-format
  18. .clang-format-ignore
  19. .clang-tidy
  20. .git-blame-ignore-revs
  21. .gitattributes
  22. .gitignore
  23. .gitmodules
  24. .gn
  25. .style.yapf
  26. .vpython3
  27. AUTHORS
  28. BUILD.bazel
  29. BUILD.gn
  30. CMakeLists.txt
  31. CMakeSettings.json
  32. CODE_OF_CONDUCT.md
  33. codereview.settings
  34. CONTRIBUTING.md
  35. CPPLINT.cfg
  36. DEPS
  37. DIR_METADATA
  38. go.mod
  39. go.sum
  40. go_presubmit_support.py
  41. LICENSE
  42. MODULE.bazel
  43. MODULE.bazel.lock
  44. OWNERS
  45. PRESUBMIT.py
  46. PRESUBMIT_test.py
  47. README.chromium
  48. README.md
  49. unsafe_buffers_paths.txt
  50. WATCHLISTS
  51. WORKSPACE.bazel
README.md

Build Status Matrix Space

Dawn, a WebGPU implementation

Dawn is an open-source and cross-platform implementation of the WebGPU standard. More precisely it implements webgpu.h that is a one-to-one mapping with the WebGPU IDL. Dawn is meant to be integrated as part of a larger system and is the underlying implementation of WebGPU in Chromium.

Dawn provides several WebGPU building blocks:

  • WebGPU C/C++ headers that applications and other building blocks use.
    • The webgpu.h version that Dawn implements.
    • A C++ wrapper for the webgpu.h.
  • A “native” implementation of WebGPU using platforms' GPU APIs: D3D12, Metal, Vulkan and OpenGL. See per API support for more details.
  • A client-server implementation of WebGPU for applications that are in a sandbox without access to native drivers
  • Tint is a compiler for the WebGPU Shader Language (WGSL) that can be used in standalone to convert shaders from and to WGSL.

Helpful links:

Documentation table of content

Developer documentation:

User documentation: (TODO, figure out what overlaps with the webgpu.h docs)

License

BSD 3-Clause License, please see LICENSE.

Disclaimer

This is not an officially supported Google product.