Skip to content

Commit

Permalink
The big split (#250)
Browse files Browse the repository at this point in the history
* remove components that now live elsewhere

* Update README.md

* re-add config/generate-kitchensink.sh for testing
  • Loading branch information
jlowellwofford authored Mar 24, 2021
1 parent 68c1e37 commit ba28824
Show file tree
Hide file tree
Showing 202 changed files with 32 additions and 34,106 deletions.
95 changes: 0 additions & 95 deletions Dockerfile

This file was deleted.

46 changes: 32 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,32 +1,48 @@
# NEW! Want to give it a spin?
# Kraken

Look under `examples/vbox` for instructions to deploy a virtual Kraken cluster with a single command. See the [README](examples/vbox/README.md).
## Reorganization notice
***Please excuse our dust. Kraken has been subdivided into different repos. This repo now only contains core components for the kraken framework; most modules and extensions have been moved elsewhere.***

# What is Kraken?
- If you're trying to provision clusters, you probably want [kraken-layercake](https://github.com/kraken-hpc/kraken-layercake)
- If you're looking for thermal control or Raspberry Pi modules/extensions, try [kraken-legacy](https://github.com/kraken-hpc/kraken-legacy)
- If you're looking for ansible roles for kraken, you probably want [kraken-layercake-ansible](https://github.com/kraken-hpc/kraken-layercake-ansible)

Kraken is a distributed state engine that can maintain state across a large set of computers. It was designed to provide full-lifecycle maintenance of HPC compute clusters, from cold boot to ongoing system state maintenance and automation.
## What is Kraken?

Kraken is a distributed state engine *framework* for building tools that can maintain and manipulate state across a large set of computers. It was designed to provide full-lifecycle maintenance of HPC compute clusters, from cold boot to ongoing system state maintenance and automation (see: [kraken-layercake](https://github.com/kraken-hpc/kraken-layercake) for this implementation).

Kraken was designed for HPC use-cases but may be useful anywhere distributed automation is needed. Kraken is designed to be highly modular and should be able to adapt to many situations.

# What do you mean by "state engine", and how does it work?
### Kraken is modular

Kraken on its own is only a framework. When combined with modules, kraken can do things. Kraken modules can discover real state values in a system an communicate them. Kraken modules can declare that they know how to "mutate" the system to different states. Kraken modules can also do things like run tiny services the system needs.

### Kraken state is extensible

Kraken maintains a copy of the desired state (called "Configuration" state, abr "Cfg"). It also is able--through specialized modules--to discover bits of current real state ("Discoverable" state, abr. "Dsc"). Kraken modules provide a list of state mutations that they can perform, e.g. for `PhysState: POWER_OFF` to `PhysState: POWER_ON`. These mutations are used to generate a directed graph. Any time a difference is detected between Configuration (intended) state and Discoverable (actual) state, Kraken computes a path of mutations to converge on the Configuration state.
Kraken starts with a very simple state-definition per node. Through *extensions* kraken can define new kinds of state information. You can loosely think of extensions as something like database schemas.

# What do you mean by "distributed state engine", and how does *that* work?
## What do you mean by "state engine", and how does it work?

Kraken distributes the state across potentially thousands of individual physical nodes. It maintains synchronization through a one-way state-update protocol, that is reminiscent of routing protocols like OSPF. It can (or will when fully implemented) create trees for multi-level state synchronization, and each level of the tree can provide a full suite of Kraken controlled microservices. State synchronization in Kraken follows the "eventual consistency" model; we never guarantee that the entire distributed state is consistent, but can provide conditional guaranties that it will converge to consistency.
Kraken maintains a copy of the desired state (called "Configuration" state, abr "Cfg"). It also is able--through specialized modules--to discover bits of current real state ("Discoverable" state, abr. "Dsc"). Kraken modules provide a list of state mutations that they can perform, e.g. for `PhysState: POWER_OFF` to `PhysState: POWER_ON`. These mutations are used to generate a directed graph. At any time, if a difference is detected between Configuration (intended) state and Discoverable (actual) state, Kraken computes a path of mutations to converge on the Configuration state.

# How do I learn more?
## What do you mean by "distributed state engine", and how does *that* work?

Kraken is brand new and in very active development. As part of the development efforts of Kraken, we will be updating the repository with more and more documentation, ranging from implementation guides to application architecture and module API guides.
Kraken distributes the state across potentially thousands of individual physical nodes. It maintains synchronization through a one-way state-update protocol that is reminiscent of routing protocols like OSPF. State synchronization in Kraken follows the "eventual consistency" model; we never guarantee that the entire distributed state is consistent, but can provide conditional guaranties that it will converge to consistency.

# Notes on this version of Kraken
## How do I learn more?

Kraken is still a fledgling sea-monster. We don't yet consider it ready for production but hope to get it there very soon. If you try to deploy in production, it will likely drink your coffee/beer/tea.
Kraken is in very active development. As part of the development efforts of Kraken, we will be updating the repository with more and more documentation, ranging from implementation guides to application architecture and module API guides. There are also a number of talks, papers, and presentations out there about Kraken and its related projects.

Check back soon for more documentation, utilities and demonstrations.
## Notes on this version of Kraken

# I want to get involved...
Kraken is still a fledgling sea-monster, but it has show itself capable of some pretty powerful things. The [kraken-layercake](https://github.com/kraken-hpc/kraken-layercake) project is our reference project for kraken capabilities. It can boot and maintain large scale compute clusters, providing unique capalities like:
- Stateful rolling updates of images in microseconds
- Self-healing capabilities at all layers of the stack
- Active feedback and monitoring of system state through tools like [kraken-dashboard](https://github.com/kraken-hpc/kraken-dashboard) and [krakenctl](https://github.com/kraken-hpc/krakenctl)

Check back soon for more documentation, utilities, and demonstrations.

## I want to get involved...

Excellent! It's our intention to make Kraken a community developed project. To get started, you can:

Expand All @@ -35,3 +51,5 @@ Excellent! It's our intention to make Kraken a community developed project. To
2) take a look at any posted issues;
3) post new issues;
4) create pull requests.

Enjoy!
1 change: 0 additions & 1 deletion config/kraken.yaml

This file was deleted.

20 changes: 0 additions & 20 deletions config/layercake.yaml

This file was deleted.

27 changes: 0 additions & 27 deletions config/pipxe.yaml

This file was deleted.

18 changes: 0 additions & 18 deletions config/powerapi.yaml

This file was deleted.

19 changes: 0 additions & 19 deletions config/powerman.yaml

This file was deleted.

25 changes: 0 additions & 25 deletions config/redfish.yaml

This file was deleted.

20 changes: 0 additions & 20 deletions config/vbox.yaml

This file was deleted.

21 changes: 0 additions & 21 deletions config/vbox_uroot.yaml

This file was deleted.

8 changes: 0 additions & 8 deletions examples/vbox-uroot/.gitignore

This file was deleted.

Loading

0 comments on commit ba28824

Please sign in to comment.