CHANGELOG.md

Changelog

0.29.0-beta (2024-09-27)

Features

• compogen: add table css and update doc (#370) (c59b167)
• document: improve image extraction from pdf (#372) (39cdb2c)
• openai: use batch inference for embedding (#375) (cc897af)

Bug Fixes

• compogen: fix json format (#364) (e6619ce)
• text: bug about table judgement in markdown chunking (#367) (1ab13e2)
• the input validator can not validate array format (#379) (38074c8)
• web: fix bugs and improve the performance (#377) (f0f4f89)

0.28.0-beta (2024-09-24)

Features

• ai: build standardised ai component (#344) (e46d228)
• collection: introduce collection component (#353) (dac1850)
• collection: introduce TASK_UNION, TASK_INTERSECTION and TASK_DIFFERENCE (#357) (1b68dad)
• document: support xls and csv (#337) (892c51f)
• instillapp: implement read and write chat message task (#348) (2c8a6a0)
• integration: support OAuth connection in Slack and GitHub components (#349) (2527767)

Bug Fixes

• compogen: fix wrong anchors and missing object descriptions (#356) (315ef6c)
• instillartifact: fix bugs (#352) (d916f3b)
• patch asana component bugs when calling real api (#328) (a821f47)
• web: fix bugs related to web operator (#351) (c390a6f)

0.27.5-beta (2024-09-18)

Features

• compogen: automate to add missing parts in the document (#324) (e5d6dfe)

Bug Fixes

• document: fix the bug from pdfplumber (#342) (72f4931)

Miscellaneous Chores

• release v0.27.5-beta (24dfda9)

0.27.4-beta (2024-09-13)

Features

• openai: add support for o1-series models (#338) (7048854)

Bug Fixes

• text: fix bugs for short file (#340) (23966e3)

Miscellaneous Chores

• release v0.27.4-beta (24aba44)

0.27.3-beta (2024-09-12)

Bug Fixes

• text: bug of infinity loop (#331) (4387219)
• text: fix memory problem (#333) (2a74fee)

0.27.2-beta (2024-09-12)

Miscellaneous Chores

• release v0.27.2-beta (2b08252)

0.27.1-beta (2024-09-11)

Bug Fixes

• document: fix memory increasing problem (#326) (e56cf5c)
• text: markdown chunking bug (#325) (9866a91)

0.27.0-beta (2024-09-10)

Features

• add asana component (#311) (d0e1335)
• add chroma component (#300) (9fa57f6)
• add Freshdesk component (#274) (b22203f)
• compogen: add reference to integrations on Setup block (#323) (497f785)
• document: improve convert to markdown (#310) (b531c13)
• document: improve pdf to markdown (#320) (adae85a)
• instill: adopt latest Instill Model protobufs (#315) (52b7d78)
• text: add table and list concept into markdown chunking (#317) (60d5fdb)

Bug Fixes

• chroma: change interface (#319) (1da8988)

0.26.0-beta (2024-08-29)

Features

• add milvus component (#299) (a48c211)
• add zilliz component (#297) (92726ef)
• artifact: improve artifact component (#289) (44ea196)
• document: improve document operator (#287) (c0d8d31)
• hubspot: add 4 tasks and modify Retrieve Association task and Get Thread task (#265) (62903ec)
• introduce interfaces InputReader and OutputWriter (#294) (e26ecef)
• jira: add action tasks (#241) (e756e31)
• make the API key be optional for Instill-Credit-supported component (#305) (0f9a7b2)
• openai: revert go-openai and add support for streaming (#301) (aa605fa)
• openai: use go-openai client (#295) (aa20a16)
• sql: add ssl/tls input as base64 encoded and move engine to setup (#282) (390e2b8)
• use error type for component definition not found error (#302) (cfcee78)
• web: improve web operator (#292) (1da84af)

Bug Fixes

• document: catch the error if there is no data in sheet (#296) (21bebbd)
• hubspot: fix test code (#298) (98c4261)
• text: fix chunk position bugs (#307) (cfc9076)
• text: fix the bug if there are 2 exact same chunks (#308) (b58909f)

0.25.0-beta (2024-08-13)

Features

• add a hook to avoid we miss make document (#244) (4c4531d)
• add elasticsearch component (#211) (eb492ca)
• add Fireworks AI component (#237) (0c40652)
• add Groq component (#269) (1401220)
• add mongodb component (#198) (2cb550f)
• add qdrant component (#271) (bd2b9e6)
• add weaviate component (#246) (cb3e667)
• add WhatsApp component (#226) (28d0de8)
• artifact: add artifact component (#268) (dabf472)
• artifact: add artifact component (#275) (15fc0d2)
• document: integrate pdf2md in document operator (#277) (07360d1)
• groq, fireworksai: take out the unsupported models from instill credit (#283) (8978acd)
• make component ID accessible on IExecution (#257) (dd63656)
• openai: support gpt-4o-2024-08-06 and structured output (#280) (8bdaef7)
• sql: add TASK_INSERT_MANY and fix sql query validation (#252) (3a93cea)
• text: add tokenizer for cohere & new gpt-4o (#276) (5d8cec3)
• text: revert "add tokenizer for cohere & new gpt-4o (#276)" (910a330)

Bug Fixes

• artifact: add the description to remind users to add file extension (#281) (5ff5d7a)
• ignore bold case and add all line to result (#272) (219c77e)

0.24.0-beta (2024-07-31)

Features

• add audio operator (#236) (fe8abff)
• add handler to auto-fill missing default values (#210) (dcad3f0)
• add HubSpot component (#199) (b3936a8)
• add Jira component (#205) (51f3ed7)
• add Ollama component (#224) (810f850)
• add sql component (#193) (9a373f3)
• add token count for each chunk (#235) (bb69104)
• add video operator to fulfil unstructured data process (#238) (a1459d7)
• document: add docx doc pptx ppt html to transform to text in markdown format (#232) (2932db9)
• document: move ConvertToText task from text operator to document operator (#248) (699ca70)
• introduce event handler interface (#253) (9599b42)
• restapi: recategorize the restapi component as a generic component (#249) (fbfc3a3)
• website: add scrape sitemap function (#239) (8648326)

Bug Fixes

• bug of duplicate document (#256) (e028a6e)
• bug of json without setting array for images (#259) (4aeae69)
• change md format to html tag for correct frontend link (#240) (7e16b2b)
• revert the alias because they are same as package name (#243) (1d9c42d)

0.23.0-beta (2024-07-19)

Features

• add new models in open ai (#229) (b8e39ae)

Bug Fixes

• fix markdown chunking bugs (#228) (2194773)
• github: patch missing fields (#227) (c61b134)
• restapi: fix response body missing problem (#222) (47a28dd)
• text: fix bug and replace markdown chunking (#221) (298c91a)

0.22.0-beta (2024-07-16)

Features

• add GitHub component (#177) (46e5a8e)
• add JQ input field that accepts any type (#201) (cba4aac)
• cohere: add Cohere component (#187) (63fd578)
• cohere: add cohere to be able to use instill credit (#213) (80415b1)
• GitHub component pagination (#212) (4b8bbc7)
• instill: send requester UID, if present, on model trigger (#202) (31422cd)
• mistral: add Mistral AI component (#204) (12aaf4f)
• openai: add dimensions in openai component (#200) (0d08912)
• text: add input and output and fix bugs (#209) (56ab3eb)
• unify pipeline and component usage handlers (#197) (e27e46c)

Bug Fixes

• fix instillUpstreamTypes not correctly render the JSON schema (#216) (bb603bd)
• mistralai: svg naming is wrong (#218) (108817a)
• text: hotfix the bug from langchaingo without importing the function o… (#217) (4cfc263)
• typo (#195) (d6b2a42)

0.21.0-beta (2024-07-02)

Features

• add mail component (#178) (04b19d0)
• add read task for gcs (#155) (77fe2fc)
• add read task in bigquery component (#156) (4d2e7ec)
• anthropic: add Anthropic component (#176) (030881d)
• anthropic: add UsageHandler functions in anthropic (#186) (ebaa61f)
• compogen: add extra section with --extraContents flag' (#171) (391bb98)
• instill: remove extra-params field (#188) (b17ff73)
• redis: simplify the TLS configuration (#194) (0a8baf7)

Bug Fixes

• all: fix typos (#174) (cb3c2fb)
• compogen: wrong bracket direction in substitution (#184) (dfe8306)
• expose input and output for anthropic for instill credit (#190) (a36e876)
• update doc (#185) (6e6639a)

0.20.2-beta (2024-06-21)

Bug Fixes

• openai: fix OpenAI image_url field can't work (#170) (f077309)
• website: fix typo (481bc83)

0.20.1-beta (2024-06-19)

Bug Fixes

• redis: fix typo (#167) (9dd783a)

0.20.0-beta (2024-06-18)

Features

• add toggle image tag function for document pdf to markdown task (#162) (f12ecd2)
• use camelCase in JSON files (#158) (ecf4dd9)
• use kebab-case for all component input and output properties (#164) (4a82be7)

0.19.1-beta (2024-06-13)

Bug Fixes

• fix component document links (#159) (fd38a8b)

0.19.0-beta (2024-06-05)

Features

• add pdf component (#138) (517afcf)
• add task chunk text (#139) (7b36553)
• instill: adopt latest Model endpoints (#146) (7f2537b)
• optimise ux for slack component (#143) (ed60235)
• refactor package structure (#140) (4853d4c)
• support markdown to text function in text operator (#149) (dcbae37)
• unify component interface (#144) (ad35e10)

Bug Fixes

• bug of failure of document component (#152) (aed51f8)

0.18.0-beta (2024-05-17)

Features

• instill: adopt latest Instill Model endpoints (#133) (a53661c)

0.17.0-beta (2024-05-15)

Features

• add additional attribute in JSON schema for Instill Credit (#118) (a6751fa)
• add global secrets to StabilityAI connector (#122) (1db0c9f)
• add sourceTag for pinecone (#117) (b202da1)
• allow global API key on OpenAI connector (#110) (42bccdd)
• implement Slack component (#120) (1ecff8a)
• openai: support gpt-4o model (#127) (536f5af)
• update Instill Credit supported model list (#123) (0b0cf81)

Bug Fixes

• Fix the bug of setting channelID (#125) (47bc192)
• slack: add instillSecret: true to token field (#126) (7751585)

0.16.0-beta (2024-04-30)

Features

• add contribution guide (#106) (3957579)

Bug Fixes

• typos in contribution guide (#108) (f01c049)

0.15.0-beta (2024-04-25)

Features

• add UsageHandler interface (#87) (b9d9645)
• adjust IConnector interface (#83) (46ea796)
• adjust Test() interface (#81) (763cc6d)
• adopt system variables (#92) (e8ae4e1)
• airbyte: remove Airbyte connectors (#88) (ec770d6)
• airbyte: remove local connector and refine definition (#85) (8203316)
• compogen: use jsonref when generating the README (#99) (ff49157)
• expose IsCredentialField interface (#93) (6cd2801)
• instill: drop support for "external mode" (#101) (b0c091b)
• merge resource spec into component spec (#86) (a6de70e)

Bug Fixes

• airbyte: add missing release_stage (#84) (9c0a57d)
• instill: add nil check for GetConnectorDefinitionByUID (0ca6fc3)
• numbers: fix recipe data bug (#103) (36480f8)

0.14.1-beta (2024-04-01)

Bug Fixes

• compogen: better installation command (#78) (f1b453b)
• instill: fix multi-region connection problem (#76) (591a6a2)

0.14.0-beta (2024-03-29)

Features

• document release stages and versions (#70) (91457dc)
• merge connector and operator repos into this repo (#72) (2fd6b1d)
• read release stage in auto generated docs from field in definitions (#68) (90ea333)
• remove pre-release label in version (#75) (f0320d3)

Bug Fixes

• document pre-release version removal (#71) (e527a11)

0.13.0-beta (2024-03-07)

Features

• expose description field in component entities (#62) (85bbc22)
• simplify openapi_specifications to data_specifications (#64) (7c27d15)

Bug Fixes

• vdp: better casting errors (#65) (81e34c4)

0.12.0-beta (2024-02-27)

Features

• create README.mdx generation command (#59) (c814c05)
• extract task title generation (#58) (52804d4)

0.11.0-beta (2024-02-14)

Features

• add tasks to component definition (#54) (b067f9c)
• introduce instillFormat: semi-structured/json (#55) (3dbaa03)

Bug Fixes

• fix instillFormat validation when using semi-structured and structured data (#56) (66fea88)
• fix bug when instillAcceptFormats has multiple values (#52) (5cbfb44)

0.10.0-beta (2024-01-28)

Features

• add task title and description in component json schema (#49) (0878f99)

0.9.0-beta (2024-01-12)

Features

• add instillUpstreamTypes: template in component condition field (#46) (60b2117)
• schema: add new instillFormat for chat history (#43) (abed794)
• update GetOperatorDefinition functions to support dynamic definition (#47) (792559e)

Bug Fixes

• connector: fix credentialFields bug inside oneOf schema (#45) (eb76043)

0.8.0-beta (2023-12-15)

Miscellaneous Chores

• release v0.8.0-beta (3c1c85c)

0.7.1-alpha (2023-11-28)

Miscellaneous Chores

• release v0.7.1-alpha (0015dff)

0.7.0-alpha (2023-11-09)

Features

• component: support json reference (#20) (bafafe9)

Bug Fixes

• component: fix instillShortDescription parser bug (#28) (7f528ae)
• component: fix jsonreference pointer bug (#29) (dc5371e)
• schema: fix schema inconsistent naming (#23) (dd7aa52)

0.6.1-alpha (2023-10-27)

Miscellaneous Chores

• release: release v0.6.1-alpha (da0483c)

0.6.0-alpha (2023-10-13)

Bug Fixes

• execution: fix empty task bug (6e15dc3)

Miscellaneous Chores

• release: release v0.6.0-alpha (120a147)

0.5.0-alpha (2023-09-30)

Miscellaneous Chores

• release: release v0.5.0-alpha (dd16044)

0.4.0-alpha (2023-09-13)

Miscellaneous Chores

• release: release v0.4.0-alpha (725b63f)

0.3.0-alpha (2023-08-03)

Miscellaneous Chores

• release: release v0.3.0-alpha (dfe81c0)

0.2.0-alpha (2023-07-20)

Miscellaneous Chores

• release: release v0.2.0-alpha (fa946bd)

0.1.0-alpha (2023-07-09)

Features

• Added object mapper implementation and basic tests (#7) (a91364b)

Miscellaneous Chores

• release: release v0.1.0-alpha (6984052)