Lalit Maganti

tp: overhaul error handling and diagnostics for the shell and bundle (#6969) Issue: https://github.com/google/perfetto/issues/6927 `trace_processor bundle` (formerly `traceconv bundle`) gave cryptic or misleading feedback when things went wrong: - Traces with nothing to enrich (e.g. a pure atrace trace, or a function_graph trace recorded **with** `symbolize_ksyms`) failed with a bare `bundle: failed to create bundle.` and no explanation. - A function_graph trace recorded **without** `symbolize_ksyms` got no feedback at all, even though its kernel addresses can never be symbolized offline. - Unwritable output paths (missing parent dir, read-only, path-is-a-dir) crashed the whole process with a `PERFETTO_CHECK`. - Extra positional arguments were silently ignored/misparsed (e.g. passing each `--symbol-paths` directory as a separate argument). - Conversion failures produced double error messages (an internal `PERFETTO_ELOG` + a generic "conversion failed" wrapper), and several paths crashed with `PERFETTO_FATAL` on ordinary user error. ## Changes - **bundle** now always produces the bundle and explains what could not be enriched, with actionable hints. It detects function_graph traces recorded without `symbolize_ksyms`, fails gracefully (instead of crashing) on unwritable output paths, and reports reading/enrichment progress. - **CLI**: every fixed-arity subcommand (`bundle`, `convert`, `util`, `export`, `query`, `server`, `metrics`) now rejects extra positional arguments with a hint, instead of silently misinterpreting them. - **traceconv**: the conversion entry points (`TraceToJson`, `TraceToSystrace`, `TraceToText`, `TraceToProfile`, `TraceToFirefoxProfile`, `UnpackCompressedPackets`, `SymbolizeProfile`, `DeobfuscateProfile`) now return descriptive `base::Status` errors instead of int/bool returns paired with internal `PERFETTO_ELOG`/`FATAL`, so failures are reported once with the actual reason. - **TarWriter**: fails gracefully when the output path cannot be opened (also fixes the same crash in `util merge`). - **Parse errors**: no longer append a redundant "The trace file is corrupt." sentence; the UI error-dialog extraction is updated for the new message format.

tp: model trace types as importers, remove the TraceType enum (#6618) Today, all trace detection logic is centralized inside TP meaning it's impossible for plugins to register new formats and have them work without also changing the core code. As the number of formats has increased, this has gotten more and more unweildy Design it to instead be structured such that new trace types can be developed fully independently *without* making any changes to the core. This will be proved out in a followup change where perf text importer will be moved.

tp: add Arrow support for dataframes (#6827) Provide an Arrow serializer and deserializer for Dataframes using a standard Arrow file containing one record batch. Primitive columns map to Arrow numeric arrays, strings map to Utf8, nullable columns carry validity bitmaps, and sparse storage uses Arrow's logical row layout. The serializer computes metadata and variable-width sizes before streaming column contents with bounded scratch memory. The deserializer validates file framing, record batch metadata, and buffer extents before rebuilding column storage, null state, implicit Id columns, and strings in the target StringPool.

tp: add a batch execution pipeline (#7135) Trace processor moves rows one at a time through a cursor. That interface works well for callers, but upstream it costs a virtual call and bounds check per row and prevents operators from working over a run of values. Add a batch pipeline alongside the cursor. RowBatch holds column views over producer-owned storage, so filtering changes a selection instead of moving values. Operators hold only plan data; mutable execution state is owned separately, which makes plans safe to reuse. Values normally live until the producer's next pull. RowStore copies them into fixed-size chunks when an operator needs to keep them longer. Later changes add sources and operators on top of these primitives.

ai: a bunch of imporvements for AI skills and TP (#7362) * add a bunch of AI evals to help us actually test the skill properly to make sure it's doing what it should be * add tp help agent and hints in general help to hint to the agent best practices and skills it should use * improve skill with learning from running evals, making pass rate higher *and* reducing token usage Fixes: https://github.com/google/perfetto/issues/6981

tp: parse PerfettoSQL pipelines (#7437) Compile PerfettoSQL `FROM ... |> TREE ACCUMULATE UP | DOWN` pipelines, including pipeline bodies in `CREATE PERFETTO TABLE`, into a logical plan. Active-name resolution retains duplicate bindings and reports ambiguity when referenced. The plan stores defining SQL names and types once under stable IDs, separates ordered output bindings, and puts each source on its scan. Direct dataframe scans retain the selected column references and row count at logical planning time, so lowering does not repeat catalog or name resolution. Table bodies hold either SQL or a logical plan. Query-schema discovery and type mapping live in a shared schema component, independent of execution; SqlScan is constructed from the resolved columns. Plan formatting is built only for tests. A TODO records the remaining need to share hidden-column metadata with DataframeModule. Validation: 79 parser, SQL-scan, and catalog unit tests. Parser tests focus on statement boundaries, macro expansion, scope and ambiguity, unsupported syntax, and tracebacks; overlapping source and execution checks remain in downstream suites.

perfetto_sql: add reusable semantic analysis (#7219)

tp: add streaming table export (#6839) Add a bounded-memory Export API for statically registered Trace Processor tables. ExportOutput is a virtual streaming interface with an optional file path alternative for formats which need direct random-access output later. Runtime SQL tables and views are deliberately outside this API. Support two explicit tar formats. kArrowTar is a stable, forwards-compatible, export-only archive containing standard Arrow files, including implicit ID columns and empty static tables for external consumers. kPerfetto is a version-coupled archive with an internal manifest which can restore tables into a compatible fresh Trace Processor instance; its representation carries no cross-version compatibility guarantee. Expose export through RPC, HTTP, the shell export subcommand, and Python. Keep the existing SQLite export path unchanged; moving it behind this API waits for the separate file-I/O abstraction work.

tp: rebuild flamegraphs from typed trees (#6942) Consume the core Tree representation directly and preserve typed values while merging top-down, bottom-up, pivot, and filtered flamegraph views. _{Stack created with <a href="https://github.com/github/gh-stack">GitHub Stacks CLI</a> • <a href="https://gh.io/stacks-feedback">Give Feedback 💬</a>}

tp: report accurate symbolization results and support quiet output (#7402)