[internal] Collect workflow data #2470
7060 tests run, 4501 passed, 1716 skipped, 843 failed.
Annotations
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 3, 4)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 3, 4)-7-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 45, 17)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 1, 23)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 1, 23)-7-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 64, 1)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 100, 100)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 100, 100)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 10, 1000)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 10, 1000)-7-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 9920, 1)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(1, 10000, 1)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 10000, 1)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 17, 41)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(1, 89, 3)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(11, 45, 17)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(11, 45, 17)-7-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(11, 1, 23)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(11, 64, 1)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(100, 100, 100)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(100, 100, 100)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(10, 1000, 100)-3-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 2}-(10, 1000, 100)-7-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator
Check failure on line 47 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(10, 10000, 1)-7-None-None]
RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:895: tt::exception
info:
Statically allocated circular buffers on core range [(x=0,y=0) - (x=7,y=7)] grow to 1499552 B which is beyond max L1 size of 1499136 B
backtrace:
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/libtt_metal.so(+0x16145b) [0x7f541ecb345b]
--- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*)
--- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::CommandQueue&, tt::tt_metal::v0::Program&, bool)
--- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&)
--- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x2595de9) [0x7f5421495de9]
--- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259020f) [0x7f542149020f]
--- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x59fe88) [0x7f541f49fe88]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x59289d) [0x7f541f49289d]
--- ttnn::operations::data_movement::ExecutePad::invoke(unsigned char, tt::tt_metal::Tensor const&, tt::stl::Span<std::pair<unsigned int, unsigned int> const, 18446744073709551615ul>, float, bool, std::optional<tt::tt_metal::MemoryConfig> const&)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6eab) [0x7f541f4f6eab]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6a08) [0x7f541f4f6a08]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f680c) [0x7f541f4f680c]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259c8a2) [0x7f542149c8a2]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259d08c) [0x7f542149d08c]
--- void tt::tt_metal::operation::launch_op_func<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(std::function<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > (std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&)> const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > >, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > >, bool)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6598) [0x7f541f4f6598]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f5fd4) [0x7f541f4f5fd4]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5e1ff7) [0x7f541f4e1ff7]
--- ttnn::operations::data_movement::pad_to_tile_vol(unsigned char, tt::tt_metal::Tensor const&, float, bool, std::optional<tt::tt_metal::MemoryConfig> const&)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x603454) [0x7f541f503454]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x609418) [0x7f541f509418]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x60918d) [0x7f541f50918d]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5e4f6d) [0x7f541f4e4f6d]
--- ttnn::operations::data_movement::ConcatOperation::invoke(unsigned char, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, int, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<tt::tt_metal::Tensor> const&, unsigned int)
--- ttnn::operations::data_movement::ConcatOperation::invoke(std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, int, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<tt::tt_metal::Tensor> const&, unsigned int)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78bbbc) [0x7f5422ecbbbc]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78bacb) [0x7f5422ecbacb]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78ba3c) [0x7f5422ecba3c]
--- void tt::tt_metal::operation::launch_op_func<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(std::function<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > (std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&)> const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > >, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > >, bool)
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78b7f4) [0x7f5422ecb7f4]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78b26d) [0x7f5422ecb26d]
--- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78aea0) [0x7f5422ecaea0]
--- tt::runtime::ttnn::operations::data_movement::run(tt::target::ttnn::ConcatOp const*, tt::runtime::ttnn::ProgramContext&)
--- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&)
--- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&)
--- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&)
--- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&)
--- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x3174f0) [0x7f542f5504f0]
--- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x31743e) [0x7f542f55043e]
--- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe0cf5) [0x7f542f319cf5]
--- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x55af046dab32]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55af046d139b]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55af046caa97]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55af046d0574]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0xc1) [0x55af046e5691]
--- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
--- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55af046e910b]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55af046c597f]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55af046e9172]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55af046d061d]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55af046e562c]
--- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55af046d139b]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55af046cb99e]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55af046c597f]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
--- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
--- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55af046d061d]
--- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55af046e562c]
--- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
--- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55af046e910b]
Raw output
@pytest.mark.nightly_sweeps
@pytest.mark.parametrize(
"test_vector", TestSuiteData.filtered.query_all().filter(VectorLambdas.ALL_OPERATORS).to_params()
)
def test_plan(test_vector: TestVector, test_device):
> TestVerification.verify(test_vector, test_device)
forge/test/operators/pytorch/test_all.py:391:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
forge/test/operators/pytorch/test_all.py:47: in verify
test_vector.verify(test_device)
forge/test/operators/utils/plan.py:121: in verify
self.test_plan.verify(test_device=test_device, test_vector=self)
forge/test/operators/pytorch/eltwise_nary/test_concatenate.py:259: in <lambda>
verify=lambda test_device, test_vector: TestVerification.verify(
forge/test/operators/pytorch/eltwise_nary/test_concatenate.py:190: in verify
VerifyUtils.verify(
forge/test/operators/utils/utils.py:165: in verify
cls.verify_module_for_inputs_deprecated(
forge/test/operators/utils/utils.py:225: in verify_module_for_inputs_deprecated
verify_module_for_inputs_deprecated(
forge/test/operators/utils/compat.py:300: in verify_module_for_inputs_deprecated
co_out = compiled_model(*forge_inputs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
def __call__(self, *inputs: AnyTensor) -> List[torch.Tensor]:
"""
Run inference on the compiled model.
Parameters
----------
inputs: [Tensor, ...]
Input tensors
Returns
-------
List[Tensor]
Output tensors
"""
self.inputs = [*to_pt_tensors(inputs)]
inputs_and_parameters = [
*self.inputs,
*self.fwd_compiled_graph_state.get_ordered_constant_tensors(),
*self.fwd_compiled_graph_state.get_ordered_parameter_tensors(),
]
assert all(
[isinstance(t, torch.Tensor) for t in inputs_and_parameters]
), "All inputs should be torch tensors by now."
if self.training() and isinstance(self.framework_module, PyTorchModule):
for name, param in self.framework_module.module.named_parameters():
if param.requires_grad:
our_tensor = self.fwd_compiled_graph_state.get_parameter_tensor(name)
# NOTE: for parameters that require gradients, we want to share the same tensor with the PyTorch
# module. This is because we want to be able to optimize the parameters both on the device
# (through our runtime) and via the torch optimizers. So this ensures that whichever side updates
# the parameter value, the other side can see the change.
#
# This could change in the future, but for now ensure that our premise is correct.
assert param is our_tensor
logger.info(
f"Running model {self.framework_module.get_name()} {self.fwd_compiled_graph_state.graph.get_name()} on device..."
)
> all_outputs = run_binary(self.compiled_binary, int(ProgramId.FORWARD), inputs_and_parameters)
E RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:895: tt::exception
E info:
E Statically allocated circular buffers on core range [(x=0,y=0) - (x=7,y=7)] grow to 1499552 B which is beyond max L1 size of 1499136 B
E backtrace:
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/libtt_metal.so(+0x16145b) [0x7f541ecb345b]
E --- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*)
E --- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::CommandQueue&, tt::tt_metal::v0::Program&, bool)
E --- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&)
E --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x2595de9) [0x7f5421495de9]
E --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259020f) [0x7f542149020f]
E --- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x59fe88) [0x7f541f49fe88]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x59289d) [0x7f541f49289d]
E --- ttnn::operations::data_movement::ExecutePad::invoke(unsigned char, tt::tt_metal::Tensor const&, tt::stl::Span<std::pair<unsigned int, unsigned int> const, 18446744073709551615ul>, float, bool, std::optional<tt::tt_metal::MemoryConfig> const&)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6eab) [0x7f541f4f6eab]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6a08) [0x7f541f4f6a08]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f680c) [0x7f541f4f680c]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259c8a2) [0x7f542149c8a2]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x259d08c) [0x7f542149d08c]
E --- void tt::tt_metal::operation::launch_op_func<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(std::function<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > (std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&)> const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > >, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > >, bool)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f6598) [0x7f541f4f6598]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5f5fd4) [0x7f541f4f5fd4]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5e1ff7) [0x7f541f4e1ff7]
E --- ttnn::operations::data_movement::pad_to_tile_vol(unsigned char, tt::tt_metal::Tensor const&, float, bool, std::optional<tt::tt_metal::MemoryConfig> const&)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x603454) [0x7f541f503454]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x609418) [0x7f541f509418]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x60918d) [0x7f541f50918d]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x5e4f6d) [0x7f541f4e4f6d]
E --- ttnn::operations::data_movement::ConcatOperation::invoke(unsigned char, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, int, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<tt::tt_metal::Tensor> const&, unsigned int)
E --- ttnn::operations::data_movement::ConcatOperation::invoke(std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, int, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<tt::tt_metal::Tensor> const&, unsigned int)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78bbbc) [0x7f5422ecbbbc]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78bacb) [0x7f5422ecbacb]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78ba3c) [0x7f5422ecba3c]
E --- void tt::tt_metal::operation::launch_op_func<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(std::function<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > (std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&)> const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > >, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > >, bool)
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78b7f4) [0x7f5422ecb7f4]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78b26d) [0x7f5422ecb26d]
E --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x78aea0) [0x7f5422ecaea0]
E --- tt::runtime::ttnn::operations::data_movement::run(tt::target::ttnn::ConcatOp const*, tt::runtime::ttnn::ProgramContext&)
E --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&)
E --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&)
E --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&)
E --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&)
E --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x3174f0) [0x7f542f5504f0]
E --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x31743e) [0x7f542f55043e]
E --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe0cf5) [0x7f542f319cf5]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x55af046dab32]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55af046d139b]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55af046caa97]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55af046d0574]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0xc1) [0x55af046e5691]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
E --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55af046e910b]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55af046c597f]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55af046e9172]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55af046d061d]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55af046e562c]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55af046d139b]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55af046cb99e]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55af046c597f]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55af046c7c30]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55af046c69ab]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55af046e84d1]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55af046ca702]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55af046db38c]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55af046d061d]
E --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55af046e562c]
E --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55af047ed464]
E --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55af046e910b]
forge/forge/compiled_graph_state.py:253: RuntimeError
Check failure on line 1 in forge/test/operators/pytorch/test_all.py
github-actions / TT-Forge-FE Tests
test_all.test_plan[no_device-concatenate-FROM_ANOTHER_OP-{'dim': 1}-(11, 17, 41)-2-None-None]
[XPASS(strict)] Not implemented operator
Raw output
[XPASS(strict)] Not implemented operator