Skip to content

Commit

Permalink
[hip][cuda] Increase the size of the query pool. (iree-org#19542)
Browse files Browse the repository at this point in the history
Some of our models now have > 30k commands in them, and each command
takes up 2 events, so increase the total so we don't run out.

Signed-off-by: Andrew Woloszyn <andrew.woloszyn@gmail.com>
  • Loading branch information
AWoloszyn authored Dec 20, 2024
1 parent 07f81f0 commit 7ff83ea
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion runtime/src/iree/hal/utils/stream_tracing.c
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
// Total number of events per tracing context. This translates to the maximum
// number of outstanding timestamp queries before collection is required.
// To prevent spilling pages we leave some room for the context structure.
#define IREE_HAL_TRACING_DEFAULT_QUERY_CAPACITY (32 * 1024 - 256)
#define IREE_HAL_TRACING_DEFAULT_QUERY_CAPACITY (128 * 1024 - 256)

// iree_hal_stream_tracing_context_event_t contains a native event that is used
// to record timestamps for tracing GPU execution. In this struct, there are
Expand Down

0 comments on commit 7ff83ea

Please sign in to comment.