diff options
| author | Oleksii Maryshchenko <oleksii.maryshchenko@gmail.com> | 2023-11-02 18:10:39 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-02 19:10:39 +0200 |
| commit | d6069051de7165a4e06662c89257f5d2905bb156 (patch) | |
| tree | 5dd3a4c2bb9293bd82e87a91a59a17dc446568d3 /common/grammar-parser.h | |
| parent | 4ff1046d75e64f0e556d8dcd930ea25c23eb8b18 (diff) | |
cuda : use CUDA memory pool with async memory allocation/deallocation when available (#3903)
* Using cuda memory pools for async alloc/dealloc.
* If cuda device doesnt support memory pool than use old implementation.
* Removed redundant cublasSetStream
---------
Co-authored-by: Oleksii Maryshchenko <omaryshchenko@dtis.com>
Diffstat (limited to 'common/grammar-parser.h')
0 files changed, 0 insertions, 0 deletions