Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PLACEHOLDER] Otel-like tracing #1346

Open
wants to merge 33 commits into
base: main
Choose a base branch
from

revert

c517908
Select commit
Loading
Failed to load commit list.
Open

[PLACEHOLDER] Otel-like tracing #1346

revert
c517908
Select commit
Loading
Failed to load commit list.
Azure Pipelines / PR Validation Eval failed Aug 22, 2024 in 8m 16s

Build #20240822.1 had test failures

7 errors / 855 warnings

Details

Tests

  • Failed: 2 (0.51%)
  • Passed: 394 (99.49%)
  • Other: 0 (0.00%)
  • Total: 396

Annotations

Check failure on line 160 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

Build log #L160 

Bash exited with code '2'.

Check failure on line 1274 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

Build log #L1274 

13 test(s) failed, 66 test(s) collected.

Check failure on line 2386 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

Build log #L2386 

Bash exited with code '2'.

Check failure on line 1274 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

Build log #L1274 

13 test(s) failed, 66 test(s) collected.

Check failure on line 1 in tests/unit/static/test_static.py::TestStatic::test_instrumentation_nemo

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

tests/unit/static/test_static.py::TestStatic::test_instrumentation_nemo 

self = <tests.unit.static.test_static.TestStatic testMethod=test_instrumentation_nemo>

    @skipIf(
        sys.version_info >= (3, 12), "nemo is not yet supported in Python 3.12"
    )
    @optional_test
    def test_instrumentation_nemo(self):
        """Check that the nemo guardrails instrumentation is up to date."""
>       from trulens.instrument.nemo import RailsInstrument

tests/unit/static/test_static.py:181: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
src/instrument/nemo/trulens/instrument/nemo/__init__.py:14: in <module>
    from trulens.instrument.nemo.tru_rails import RailsActionSelect
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

    """
    NeMo Guardrails instrumentation and monitoring.
    """
    
    import inspect
    from inspect import BoundArguments
    from inspect import Signature
    import logging
    from pprint import pformat
    from typing import Any, Callable, ClassVar, Dict, List, Optional, Tuple, Union
    
    from langchain_core.language_models.base import BaseLanguageModel
    from nemoguardrails import LLMRails
    from nemoguardrails import RailsConfig
    from nemoguardrails.actions.action_dispatcher import ActionDispatcher
    from nemoguardrails.actions.actions import ActionResult
    from nemoguardrails.actions.actions import action
    from nemoguardrails.actions.llm.generation import LLMGenerationActions
    from nemoguardrails.kb.kb import KnowledgeBase
    from pydantic import Field
    from trulens.core import feedback
    from trulens.core.app import base as mod_app
    from trulens.core.instruments import ClassFilter
    from trulens.core.instruments import Instrument
>   from trulens.core.schema import Select
E   ImportError: cannot import name 'Select' from 'trulens.core.schema' (/home/vsts/work/1/s/src/core/trulens/core/schema/__init__.py)

src/instrument/nemo/trulens/instrument/nemo/tru_rails.py:25: ImportError
Raw output 
/home/vsts/work/1/s/src/instrument/nemo/trulens/instrument/nemo/tru_rails.py:25: ImportError: cannot import name 'Select' from 'trulens.core.schema' (/home/vsts/work/1/s/src/core/trulens/core/schema/__init__.py)

Check failure on line 1 in tests/unit/static/test_static.py::TestStatic::test_instrumentation_nemo

See this annotation in the file changed.

@azure-pipelines azure-pipelines / PR Validation Eval

tests/unit/static/test_static.py::TestStatic::test_instrumentation_nemo 

self = <tests.unit.static.test_static.TestStatic testMethod=test_instrumentation_nemo>

    @skipIf(
        sys.version_info >= (3, 12), "nemo is not yet supported in Python 3.12"
    )
    @optional_test
    def test_instrumentation_nemo(self):
        """Check that the nemo guardrails instrumentation is up to date."""
>       from trulens.instrument.nemo import RailsInstrument

tests/unit/static/test_static.py:181: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
src/instrument/nemo/trulens/instrument/nemo/__init__.py:14: in <module>
    from trulens.instrument.nemo.tru_rails import RailsActionSelect
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

    """
    NeMo Guardrails instrumentation and monitoring.
    """
    
    import inspect
    from inspect import BoundArguments
    from inspect import Signature
    import logging
    from pprint import pformat
    from typing import Any, Callable, ClassVar, Dict, List, Optional, Tuple, Union
    
    from langchain_core.language_models.base import BaseLanguageModel
    from nemoguardrails import LLMRails
    from nemoguardrails import RailsConfig
    from nemoguardrails.actions.action_dispatcher import ActionDispatcher
    from nemoguardrails.actions.actions import ActionResult
    from nemoguardrails.actions.actions import action
    from nemoguardrails.actions.llm.generation import LLMGenerationActions
    from nemoguardrails.kb.kb import KnowledgeBase
    from pydantic import Field
    from trulens.core import feedback
    from trulens.core.app import base as mod_app
    from trulens.core.instruments import ClassFilter
    from trulens.core.instruments import Instrument
>   from trulens.core.schema import Select
E   ImportError: cannot import name 'Select' from 'trulens.core.schema' (/home/vsts/work/1/s/src/core/trulens/core/schema/__init__.py)

src/instrument/nemo/trulens/instrument/nemo/tru_rails.py:25: ImportError
Raw output 
/home/vsts/work/1/s/src/instrument/nemo/trulens/instrument/nemo/tru_rails.py:25: ImportError: cannot import name 'Select' from 'trulens.core.schema' (/home/vsts/work/1/s/src/core/trulens/core/schema/__init__.py)
View more details on Azure Pipelines