-
Notifications
You must be signed in to change notification settings - Fork 101
Release Notes
The major changes in this release are updates and added functionality in the stream operators for fusion and synchronization, operators for interpolation and sampling, and operators for generating streams. The release also includes a number of other updates and bug fixes - see more details below.
A number of changes have been made to the set of interpolators, and the synchronization operators (for the latest documentation on synchronization and fusion see here):
- The set of interpolators has been restructured, generalized and expanded. Interpolators can now produce a result that has a different type than the input message type, and allow for matching with the
Nearest
,First
orLast
message. A taxonomy of greedy versus reproducible interpolators has been defined. - Added support for an adjacent-values-interpolator, and constructed a linear interpolator based on it.
- The existing
Join
operator that allows for reproducible stream fusion and correct synchronization now operates with reproducible interpolators. - A
Fuse
operator has been added to enable stream fusion with any generic interpolator (reproducible or greedy). - Interpolators now accept a user-specified default value to use.
A number of other operators for sampling, generating streams, and statistical computations have also been updated:
- Redesign of
Sample
andInterpolate
stream operators. Both operators are driven by a clock stream. TheSample
stream operator selects the nearest message to the sampling point (within a tolerance or relative time window). TheInterpolate
operator uses a specified interpolator to generate the result. The documentation for sampling and interpolation is available here. - The
Generators.*
methods have been updated to allow the developer to specify whether the generated streams should stay open or close after the enumeration terminates. The current documentation on stream generators is available here. - Refactoring and clean-up of mathematical and statistical operators.
- Added extension methods to provide access to graph-wide statistics such as total queued messages, total dropped, etc. across the whole graph.
- Enabing diagnostics at pipeline creation time (e.g.
Pipeline.Create(true, ...)
) used to take an optionalTimeSpan
interval. Now it takes an optionalDiagnosticsConfiguration
; containing this and other settings. - New
DiagnosticsConfiguration.TrackMessageSize
flag determines whether message byte counts are tracked (false
by default, as it is an expensive operation).
- Minor icon updates.
- Ensure that dialog boxes appear above the PsiStudio main window.
- Moved
EncodedImage
andEncodedImagePool
out ofMicrosoft.Psi.Imaging.Windows
and.Linux
into the central .NET Standard sharedMicrosoft.Psi.Imaging
. This is to enable referencing a singleEncodedImage
type across platforms. - Interop: Updated CSV format docs for new behavior.
- Added sensor_msgs/Image message type to the ROS bridge.
- Added more informative exception message when posting messages on a stream with out-of-order sequence IDs.
- Fixed bug in pipeline diagnostics capture regarding counts of messages dropped.
- Fixed bug in queue-size-constrained delivery policies (including
DeliveryPolicy.Latest
) which sometimes led to a queue size larger by one than the max, and allowed additional messages to be processed.
- As a result of the re-organization of interpolators, the
Match
static class and the interpolators it contained have been renamed. Specifically:Match.Best
->Reproducible.Nearest
,Match.Exact
->Reproducible.Exact
; similar for the OrDefault versions. -
Interpolator<T>
was replaced withInterpolator<TIn, TOut>
to support interpolation to a different output type. -
Generators.Sequence
,Generators.Repeat
andGenerators.Range
require specifying an explicit time interval (previously the time interval parameter was optional and defaulted to 1 tick). - The existing overloads of the
Sample
stream operator that used an interpolator were renamed toInterpolate
. - The OpenCV Sample (see Public\Samples\OpenCVSample) now requires OpenCV 4.1.1 to compile. You must also set the environment variable OpenCVDir_V4 to point to your local installation of OpenCV 4.1.1.
- Enabing diagnostics (e.g.
Pipeline.Create(true, ...)
) now takes an optionalDiagnosticsConfiguration
rather than aTimeSpan
interval.
The main highlights in this release are:
- A major refresh of the
Platform for Situated Intelligence Studio
user interface, including a new color scheme, updated icons, and new functionality.
- The installation documentation has been updated to detail how to build the \psi codebase on Windows (using either Visual Studio 2017 or 2019), or on Linux.
- Updated the look and feel of the user interface, including new colors and icons.
- The
Datasets
treeview and theVisualizations
treeview now featureExpand All
andCollapse All
buttons to fully expand and collapse the tree. - The
Visualizations
treeview now contains a new button to synchronize between it and theDatasets
treeview. When a stream in theVisualizations
treeview is selected, clicking this button will select the source stream in theDatasets
treeveiw and bring it into view. This feature is useful for those times when you forget exactly which source stream a visualization is depicting. - When in
Live
cursor mode, the timing information for the selection start and end markers is now not displayed as this information is irrelevent when in live mode. - Added new context menu item
Zoom to Stream Extents
to streams in theVisualizations
tree view. - Added new context menu item
Zoom to Panel Extents
to panels in theVisualizations
tree view.
- Fixed a bug in the
Join
operator that made it not correctly take into account open relative time intervals. See this issue. - Fixed bug in the
Diagnostics
visualizer where connectors between subpipelines were being incorrectly rendered. - Fixed bug in the
Diagnostics
visualizer that would cause it to crash if it encountered messages with unserializable fields. We now return 0 for the size of such messages. - Fixed bug in
Rodrigues
method in theOrientation
class ofMicrosoft.Psi.Kinect.Windows
. This method was returning an NaN rotation matrix when passed a zero rotation vector, it now returns an identity matrix instead.
IMPORTANT NOTE:
In this release we have retargeted all .NET Framework projects to .NET Framework 4.7.2, and all native projects to Windows 10 SDK version 10.0.18362.0. In order to build the source code, please ensure that the following additional components are added to your Visual Studio installation:
If you are using Visual Studio 2019, you may install these components using the Visual Studio Installer, or via the download links provided above. For Visual Studio 2017, you may use the Visual Studio Installer to install the .NET Framework 4.7.2 targeting pack, but you will need to download and install the Windows 10 SDK (10.0.18362.0) using the provided link.
Some of the main highlights in this release include:
- Support for pipeline structure visualization, including message flow and diagnostics information (e.g. latencies, throughputs, stream statistics, etc.).
- Retargeted projects to .NET Framework 4.7.2 and Windows 10 SDK 10.0.18362.0.
- Updated NuGet package references in many projects to more recent versions.
- Runtime API changes and bug fixes.
- Moved documentation to wiki pages.
- Created gitter channel.
- The
ISourceComponent.Stop
method now takes afinalOriginatingTime
argument representing the pipeline shutdown time and anotifyCompleted
delegate which the component must now call to notify the pipeline that it has completed generating source messages up to thefinalOriginatingTime
. For more details, see here. - Pipeline exception handling is now exposed through new
PipelineException
event rather than overloading thePipelineCompleted
event to also serve as an exception handler. - Input and output connectors for subpipelines should now be constructed using the new
CreateInputConnectorFrom
andCreateOutputConnectorTo
static methods of theSubpipeline
class. - The
Match.Any
interpolator has been removed. - Enabing diagnostics at pipeline creation time (e.g.
Pipeline.Create(true, ...)
) used to take an optionalTimeSpan
interval. Now it takes an optionalDiagnosticsConfiguration
; containing this and other settings.
Several significant changes were made to the pipeline startup and shutdown logic:
- There is now a single scheduler for the main pipeline and all subpipelines. To facilitate management of work items in subpipelines, a new
SchedulerContext
has been introduced to which work items may be assigned. - Message delivery in a pipeline is now delayed at startup until all source components in the pipeline have been activated.
- To enable correct and reproducibile pipeline shutdown, changes were made to the
ISourceComponent
that will need to be implemented by stream sources. For more details, see here. - Renamed the
PipelineElement
Start
andStop
methods toActivate
andDeactivate
respectively. - Added a check in
Receiver.OnSubscribe
to ensure that emitters and receivers are not connected across pipelines (connectors should be used instead). - Changes to the pipeline exception handling mechanism via a new
PipelineException
event. - New
DiagnosticsConfiguration.TrackMessageSize
flag determines whether message byte counts are tracked (false
by default, as it is an expensive operation).
- Updated
ParallelSparse
andExporter
to use the composite component pattern, i.e. they are now implemented as a single subpipeline component. - Added
MessageConnector
andIConnector
interface to support connectors that wrap the entire message as they pass it along (used byExporter
). - Added new static methods
CreateInputConnectorFrom
andCreateOutputConnectorTo
onSubpipeline
for creating connectors between pipelines. - Changed the
StreamEnumerable
component (used by theToObservable
operator) to listen to theUnsubscribed
event of its source rather than thePipelineCompleted
event.
- New pipeline diagnostics visualization feature enables visualization of the pipeline structure and message flow statistics in PsiStudio.
- Added a new toolbar button that lets the user toggle whether the navigator's cursor follows the mouse cursor when in manual cursor mode. This setting can be toggled via the button and also via the shortcut "Alt+F" (enabled by default).
- When playing back in repeat/loop mode, we now ensure the cursor remains visible after looping from the end of the stream back to the beginning.
- Added support for visualizing streams of strings.
- Generic message visualizer now shows string representation of message in live legend.
- Added support for formatting in legends.
- Moved rectangle and coordinate system visualizers out of PsiStudio and into Visualization.Common.
- Created interface IView3D as well as a base version for handling collections of 3D visuals.
- Created a single base 3D visualization object, removing a lot of duplicate code.
- Fixed an issue which caused the pipeline to appear to hang if an exception is thrown in a subpipeline's attached
PipelineRun
event handler. - Fixed a bug in PsiStudio where the cursor remains a hand after dragging within a timeline visualization panel.
- Fixes to various visualizers (cleaned-up pattern for InitNew and handling config and property changes).
- Fixed an issue where live stores sometimes had no last message time.
- Fixed an AccessViolation related to
IAudioEndpointVolumeCallback
in the Windows audio components. - Fixed a bug in one of the tuple-flattening
Join
operator overloads which was causing it to use the incorrect interpolator. - Fixed a thread safety issue in the
Join
operator. - Fixed a thread cleanup issue on disposal in
InfiniteFileWriter
.
There are many additions and updates in this release, but the major changes can be summarized as:
- Improvements and fixes to the pipeline shutdown procedure, as well as fixes to the
Parallel
andJoin
operators to support reproducible dynamic sub-pipeline construction and teardown via theParallel
operator. - Streamlining the use of
Shared<T>
for more efficient messaging of large objects such as images, and added in-depth documentation on this topic. - PsiStudio now supports connecting to live stores and fast layout switching.
- The pipeline startup and shutdown procedure has been updated to support correct and reproducible shutdown where possible in dynamic pipelines. Specifically:
- Removed the
RegisterPipelineStart/Stop/Final
handlers. If the component implementsISourceComponent
, then use theStart
orStop
method, or use one of the following events instead:PipelineRun
,PipelineCompleted
,Receiver.Unsubscribed
. - The authoring of source components has been streamlined, and in the process the
IFiniteSourceComponent
andISourceComponent
interfaces have been unified into a single, newISourceComponent
interface. Implementers should call thenotifyCompletionTime
delegate supplied in the interface'sStart
method to indicate its completion time (orDateTime.MaxValue
if it is infinite).
- Removed the
- Removed
GroupBy
operator. -
MessagePack
no longer uses LZ4 compression during serialization, and now emitsDateTime
objects as Ticks rather than string representations.
There have been multiple changes made to the pipeline finalization code to support an orderly shutdown process.
- Subpipeline now has independent scheduler so that it may fully shut down independently of the main pipeline.
- Renamed several
Pipeline
events:-
PipelineCompletedEvent
event has been renamedPipelineCompleted
. -
ComponentCompletedEvent
event has been renamedComponentCompleted
. -
PipelineCompletionEventArgs
class has been renamedPipelineCompletedEventArgs
. - A new event
PipelineRun
has been added, it is raised whenPipeline.Run
(orPipeline.RunAsync
) has been called but before the components have started work.
-
-
Receiver
component now provides anUnsubscribed
event. -
Scheduler
now drops messages that were posted after the pipeline has shut down. -
Scheduler.Schedule
method now returns an indication of whether the call was ignored due to the pipeline having already shut down. - Bug fix in
ParallelSparse
so it works correctly with various branch termination policies. - Pipeline pause for quiescence now includes all child subpipeline schedulers.
- Fixed bug in the
ToEnumerable
operator where empty streams were not being handled correctly.
- Default branch termination policy now returns the OriginatingTime of the last message from that branch.
-
Parallel
operators now use aConnector
to bridge to Subpipelines. - Added a fix for Parallel with orDefault, which was not working properly in some cases due to errors in the matching function.
- Fixed bug in
Join
operator relating to the dynamic closing of secondary streams. - Fixed bug in
Match
component'sNearestMatch
function where if there were no available messages we would always returnInsufficientData
. We now first check if the stream is closed, and in this case we returnDoesNotExist
instead.
- The
Shared<T>.Create
method no longer supports specifying a SharedPool to which shared objects may be recycled. Recyclable shared objects must now be created from a shared pool. - The
SharedPool<T>.GetOrCreate
method no longer supports specifying a construction delegate, it must now be provided when theSharedPool<T>
is created.
- Added grammar-based intent detectors using
Microsoft.Speech
andSystem.Speech
- We now ensure that messages have monotonically increasing OriginatingTimes in the
MicrosoftSpeechRecognizer
component to comply with the new rule on theEmitter
component introduced in the last release. - Added support for
AzureSpeechServices
and marked as deprecated the obsolete componentBingSpeechRecognizer
. - The Speech event duration is now defined as the OriginatingTime of the last message where the VAD was still false (before it switched to true) to the last message where the VAD output was still true. Previously we were defining the event duration as the OriginatingTime of the first message where the VAD switched to true to the OriginatingTime of the first message where it went false again.
- Added
Reframe
operator toAudio
.
- Added new Psi component
PersonalityChat
to the Microsoft.Psi.CognitiveServices.Languages.Windows project that wraps Project Personality Chat.
- Removed all of the COM features that allowed a Psi application to launch and control PsiStudio. See next point.
- PsiStudio can now connect directly to the store of a running Psi application in the same way it connects to a previously created store. Users can seamlessly switch between Live mode and Playback mode when visualizing a live store.
- Simplified the hierarchy of
VisualizationObject
classes. - Added option to show tracking id in the
kinect body
visualizer. - When multiple audio streams are being visualized, users can now select which audio source should be played through the user's PC speakers by right-clicking the relevent stream in the
Visualizations
view. - Added new
Repeat
button to the toolbar so that playback will loop infinitely between theSelection Start
andSelection End
markers. - The position and layout of PsiStudio is now preserved when the application is shut down and is restored the next time PsiStudio is launched.
- Added
Layout Chooser
to the toolbar. This allows the user to quickly switch between different Visualization layouts. Users can create new layouts either from scratch or based on an existing layout and then save this new layout. Layouts are stored in/MyDocuments/PsiStudio/Layouts/
. - Loading and then switching between multiple sessions is now correctly supported. When a Visualization layout is selected, switching to a different session will automatically cause all Visualizers to rebind to the stores associated with this newly selected session.
- Added new icons to indicate when a
Visualization
has no stream to bind to in the current session.
- Fixed bug where the final extent of the store on disk was not being correctly truncated to the actual stream size after pipeline shutdown.
- Fixed bug in PsiStudio where zooming out a long way would cause the app to apparently freeze.
- Fixed bug where
StoreWriters
andStoreReaders
were generating different names for the same global mutex that indicated a store was currently live and being written to. - Fixed bug where replay time intervals in parent pipelines did not take into account the replay time intervals in subpipelines.
- Fixed memory leaks in
Microsoft.Psi.Imaging.Operators
class. - Improved performance of the serialization classes.
- Reduced startup delays in subpipelines.
- It is now a requirement that messages posted on an
Emitter
have strictly increasing originating times. Attempting to post multiple messages with the same originating time on the same stream will cause an exception to be thrown. - The
Buffer
,History
andWindow
operators have been unified as a single set ofWindow
operators which take either an index-based or a relative time-based interval. The index-based variants emit the initial buffer only after the total count of messages within the specified index interval have been accumulated, whereas the time-based variants emit the initial buffer as soon as messages within the specified relative time interval are available. - The following operators have been removed:
-
SelectMany
. -
Mirror
. -
Repeat
- usePair
instead. -
Buffer
- useWindow
instead. -
History
- useWindow
instead. Previous
-
-
Delivery Policies have been simplified and renamed:
- The
Throttled
policy has been removed. It will be re-introduced in a later release once issues around throttling have been resolved. - The
Default
,Immediate
andImmediateOrThrottle16
policies have been removed. - The
QueueSize
property has been renamedInitialQueueSize
. - The
MaximumLag
property has been renamedMaximumLatency
. - The
IsSynchronous
property has been renamedAttemptSynchronous
.
- The
- As a result of the above changes, many stream operators have been amended to take an optional
DeliveryPolicy
parameter. - The constructors for the
Connector
component and associatedCreateConnector
extension methods no longer take anowner
parameter. - The serialization format for
SystemCalibration
has changed:- The
ImageWidth
andImageHeight
properties have been removed. - The
NumberOfFrames
property has been moved to theCameraCalibration
class.
- The
- The
ICameraIntrinsics
interface has changed:- The signature of the
DistortPoint
method has changed.
- The signature of the
New Features in Platform for Situated Intelligence Studio:
- Updated the layout of the main Psi Studio screen. The Datasets tree view and the Visualizations tree view have been moved to the left hand side of the application. Furthermore they are no longer on separate tabs, they appear one above the other so that users no longer have to switch back and forth between tabs while laying out the visualizations. Datasets and Visualizations previously each had their own Properties pages, but now there is a single Properties page on the right hand side of the application that is able to display the properties of either type of object. Both the Datasets and Visualizations tree views and the Properties page can be resized or hidden completely to give more screen real estate to the main Visualization view.
- Added multi track event visualizer
TimeIntervalHistoryVisualizationObject
which is useful for visualizing multiple tracks of events having some finite timespan such as multiple speech-to-text streams. This visualizer will be loaded when visualizing streams containing messages of typeDictionary<string, List<(TimeInterval, string)>>
. TheDictionary
keys represent unique track IDs, each element in theList
represents an event to display in the track and contains a tuple of theTimeInterval
representing the start and end times of the event and a string representing the text that will be displayed inside the time interval. Note that since this is a history visualizer, each message should contain ALL events that have occurred up until the time of the message. This implies that the last message in the stream contains all of the data required to display the visualization. - Users can now visualize streams by dragging them from the Datasets tree view directly into the main Visualization panel.
- Added 'Snap to Stream' functionality on certain visualizers to snap the cursor to the messages of the snapped stream.
- Added 'Visualize Messages in New Panel' and 'Visualize Latency in New Panel' commands to the stream context menu.
- Psi Studio now automatically attempts to repair corrupted stores when opening them.
New Features in Platform for Situated Intelligence Runtime/Core:
- Initial version of data interop with the introduction of
Microsoft.Psi.Interop
, with support for MessagePack, JSON and CSV data formats and ZeroMQ transport. See the Interop topic for more details. - New
dynamic
store reader allows reading any stream from any store todynamic
primitives or toExpandoObject
ofdynamic
without requiring a reference to the .NET type of the stream messages. - New
PsiStoreTool
command-line tool which allows exploration of available streams in a store, conversion to other formats using interop, and saving to disk or sending over a message queue for consumption by other platforms and/or languages. - Exposed
Scheduler
as a parameter toPipeline
andClock
as a parameter toScheduler
. - Multiple handlers may now be registered on start, stop and final pipeline events.
- Improved
#TRACKLEAKS
debug information inRecyclingPool
.
New Features in Imaging:
- Added
SetPixel
method toImage
. - Added
DrawText
extension method forImage
. - Added support for
CameraIntrinsics
andCoordinateSystem
toSystemCalibration
. - The
IKinectCalibration
interface andKinectCalibration
class have been extended to support conversion from depth coordinates to color space coordinates using the newToColorSpace
operator.
Bug Fixes:
- Fixed several issues where visualization objects were not being displayed in the correct color in Psi Studio.
- Fixed a bug which would sometimes cause Psi Studio to crash when visualizing image streams.
- Fixed a bug which caused the mouse to move the cursor position during playback in Psi Studio.
- Fixed an issue causing streams to disappear at the end of playback in Psi Studio.
- Fixed a crash in Psi Studio when opening a layout created from a store which has since been deleted.
- Fixed a bug which sometimes caused timeline plots to be truncated when loading a layout in Psi Studio.
- Fixed an exception when closing Psi Studio after a live visualization session.
- Fixed a performance issue reading from Psi stores which occurred at the transition between consecutive data files.
- Fixed a bug where the
ImageCompressor
was not properly disposing of an encoded image after decoding it. - Fixed a bug where
ImagePool
would sometimes return a recycled image with incorrect dimensions. - Fixed a bug where the pipeline replay interval would sometimes extend beyond the lifetime of a stream being read from a store.
- Fixed a bug which caused
KinectSample
to crash when it detected no faces. - Fixed the
Scale
image extension method to throw an exception when attempting to call it on anImage
with an unsupported format. - Fixed a few intermittently failing unit tests.
- Fixed a bug which sometimes caused a loss of precision when computing the current pipeline time.
For this release we have added the compiler switch /Qspectre to our C++ projects which helps mitigate against Spectre security vulnerabilities. In order to successfully compile the Platform for Situated Intelligence solution you must upgrade your Visual Studio instance to version 15.7 or later and add the two following components to your Visual Studio installation:
- VC++ 2017 version version_number Libs for Spectre (x86 and x64)
- Visual C++ ATL (x86/x64) with Spectre Mitigations
For more information on the Spectre vulnerabilities and information about how to add the above components to Visual Studio, please see the following pages:
New Features in Platform for Situated Intelligence Studio:
- Added new PlotStyles to Timeline Visualizer. Plots can be rendered with the following styles:
- Direct (default): A straight line is drawn from each message to the next message to create a standard line plot.
- Step: Messages are joined by a horizontal line followed by a vertical line for visualizing quantized data.
- None: No lines are drawn between messages. If you select this plot style then you should also update the MarkerStyle from its default value of None or nothing will be drawn in the plot.
- Visualization Panels in Psi Studio can now be resized by dragging their bottom edge vertically.
- Visualization Panels can now also be re-ordered with the mouse via drag & drop.
- Users can now drag the visible portion of a Timeline Plot to the left or right using the mouse.
- Added modal window while loading a dataset to inform the user of the progress of the data load operation.
- Added new timing information toolbar buttons. These buttons can be used to display absolute message times, message times relative to the start of the session, and message times relative to the start of the current selection.
- Performance improvements when plotting messages.
New Features in Runtime:
- Join operator now matches against a final secondary message upon stream closing once it can be proven that no better match will exist.
- Added support for Parallel operators that take an Action rather than a Func.
- Adding components once a pipeline is running is no longer supported and now throws an exception. The recommended approach is to add a Subpipeline.
- Consolidated Windows SDK versions. Previously different parts of the toolset required different WinSDK versions, consolidated so that the only Windows SDK version that Psi now requires is 10.0.17134.0
- Improved how the pipeline shuts down to ensure that all existing messages are drained from it before stopping.
Bug Fixes:
- Fixed bug where switching Psi Studio from "Realtime" mode to "Playback" mode would result in the user being unable to move the timeline cursor or reposition the timeline.
- Fixed bug where we were trying to calculate the relative path of a partition to a dataset when the dataset was stored on the local disk but the partitions within the dataset were stored on a network share.
- Fixed bug where loading very large datasets would sometimes crash PsiStudio.
BREAKING CHANGES in this release:
- Removed several versions of the Parallel operator
- Renamed several components for consistency:
- AudioSource -> AudioCapture
- AudioSourceConfiguration -> AudioCaptureConfiguration
- AudioConfiguration (on linux) was eliminated and replaced by two corresponding classes AudioCaptureConfiguration and AudioPlayerConfiguration
- TransformImageComponent -> ImageTransformer
- AcousticFeatures -> AcousticFeaturesExtractor
- AcousticFeaturesConfiguration -> AcousticFeaturesExtractorConfiguration
- Renamed Parallel component to ParallelFixedLength to match naming convention with the other components.
- Partial speech recognition results for the SystemSpeechRecognizer, MicrosoftSpeechRecognizer and BingSpeechRecognizer components are now posted on a new stream named PartialRecognitionResults. The default Out stream now contains only final recognition results.
- Psi Studio will no longer load third party visualizers, for the time being it will only display its built-in visualizers.
Interim release with support for new devices, runtime enhancements and several API changes, as well as minor bug fixes:
- Added support for RealSense depth camera
- Added the
FFMPEGMediaSource
component for Linux - Added a [
Subpipeline
] class, enabling nested pipelines -
Parallel
now uses subpipelines -
Sequence
,Repeat
andRange
generators now allow time-aligned messages - Additional minor bug fixes.
Several API changes have been made:
-
Generators.Timer(...)
is nowTimers.Timer(...)
-
IStartable
has been replaced byISourceControl
/IFiniteSourceControl
and the way that components get notified about the pipeline starting and stopping has changed
Interim release with a few changes to the samples and some minor bug fixes:
- ArmControlROSSample is now RosArmControlSample.
- PsiRosTurtleSample is now RosTurtleSample.
- Added LinuxSpeechSample.
- KinectFaceDetector component now outputs an empty list if no face is detected.
- NuGet packages are now marked beta.
- Additional minor bug fixes.
Initial, beta version of the Platform for Situated Intelligence. Includes the Platform for Situated Intelligence runtime, visualization tools, and an initial set of components (mostly geared towards audio and visual processing). Relevant documents:
- Documentation - top-level documentation page for Platform for Situated Intelligence.
- Platform for Situated Intelligence Overview - high-level overview of the platform.
- NuGet Packages List - list of NuGet packages available in this release.
- Building the Code - information about how to build the code.
- Brief Introduction - brief introduction on how to write a simple application.
- Samples - list of samples available.
The Roadmap document provides insights about future planned developments.
- Basic Stream Operators
- Writing Components
- Pipeline Execution
- Delivery Policies
- Stream Fusion and Merging
- Interpolation and Sampling
- Windowing Operators
- Stream Generators
- Parallel Operator
- Intervals
- Data Visualization (PsiStudio)
- Data Annotation (PsiStudio)
- Distributed Systems
- Bridging to Other Ecosystems
- Debugging and Diagnostics
- Shared Objects
- Datasets
- Event Sources
- 3rd Party Visualizers
- 3rd Party Stream Readers
Components and Toolkits
- List of NuGet Packages
- List of Components
- Audio Overview
- Azure Kinect Overview
- Kinect Overview
- Speech and Language Overview
- Imaging Overview
- Media Overview
- ONNX Overview
- Finite State Machine Toolkit
- Mixed Reality Overview
- How to Build/Configure
- How to Define Tasks
- How to Place Holograms
- Data Types Collected
- System Transparency Note
Community
Project Management