1
0
mirror of https://github.com/bigchaindb/bigchaindb.git synced 2024-06-26 11:16:44 +02:00
Commit Graph

202 Commits

Author SHA1 Message Date
Troy McConaghy
ca394bbb93 Fixed indent of ConfigMap ref to BDB public key 2017-06-30 15:11:48 +02:00
Krish
b33f718097 Use ConfigMap values in bigchaindb-dep.yaml (#1618)
* Use ConfigMap values in bigchaindb-dep.yaml

* Removed comments from top of bigchaindb-dep.yaml

Because they didn't add much information and they also contained a dated Docker Hub version tag.
2017-06-30 14:59:14 +02:00
Troy McConaghy
c7a6544070 Updated Docker image tag in MongoDB agent Deployment YAML files 2017-06-30 11:09:19 +02:00
Troy McConaghy
3dd30365ee Merge pull request #1614 from bigchaindb/editing-node-on-k8s-page
Editing node on k8s page
2017-06-30 10:12:48 +02:00
Troy McConaghy
1034db1ce5 Fixed name of https-certs volume mount in nginx-3scale-dep.yaml 2017-06-29 15:32:08 +02:00
Troy McConaghy
54e0fc4f57 Clarify the required SSL cert order in cert chain 2017-06-29 11:28:51 +02:00
Troy McConaghy
0feaafef2b entire HTTPS cert chain is needed in secret.yaml 2017-06-28 16:40:52 +02:00
Troy McConaghy
1d6a7624f4 Removed un-needed trailing comma in secret.yaml 2017-06-28 15:44:39 +02:00
Krish
d92f5f2024 Documentation changes (#1595)
* Add documentation for `bdb-user` parameter

* Remove the bdb-keyfile-passphrase parameter

* Formatting changes in bdb-certs.bdb-user subsection
2017-06-28 15:35:26 +02:00
Sylvain Bellemare
190a623226 Update kubernetes docker image version 2017-06-23 10:50:49 +02:00
Krish
9ceea89537 Enable Auth over TLS connections (#1552)
* Changes to support auth on the infrastructure
* Auth over TLS/SSL support in BigchainDB, MongoDB, Monitoring Agent, Backup Agent
* Update certificates: Different OUs specified now
* Code formatting
- Make flake happy!
* Raise proper authentication failed error
* Documentation changes for auth
* Support auth in k8s deployment
* Commit certs for monitoring and backup agents
* Configuration to allow Cloud Manager Backup Agent to backup data
* Update docs and remove authentication error
2017-06-22 16:32:04 +02:00
Krish
a175f371b0 Bump up nginx-3scale version number (#1575) 2017-06-22 14:05:37 +02:00
Krish
bca835fed7 Cloud manager GroupID update (#1551)
* Update docker image for mongodb monitoring agent

* Update docker image for mongodb backup agent

* Update secret.yaml and documentation with GroupID requirement

* Delete redundant lines from config file from entrypoint script

* Rename secret and keys
2017-06-16 14:10:21 +02:00
Troy McConaghy
945ed81038 Responses to review comments from @krish7919 on #1526 2017-06-09 14:32:39 +02:00
Troy McConaghy
e1082af385 Added clarifying comments to secret.yaml 2017-06-08 17:42:30 +02:00
Troy McConaghy
03e9020909 Added helper comments to config-map.yaml 2017-06-08 17:41:38 +02:00
krish7919 (Krish)
2cde05a204 Remove redundant configs in nginx-dep.yaml 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
9f5bad6498 Changes as per @ttmc's comments
- Renumbered steps in documentation
- Clarification on DNS prefix name
- Removed redundant port mappint in nginx-svc.yaml file
2017-06-06 10:01:53 +02:00
krish7919 (Krish)
99fb96c9c6 Update description in documentation 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
75c33dbcf1 Remove base 64 encoding requirement from ConfigMap 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
8fb1c0be8b Update docs to reflect TLS setup 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
54189ba418 Credential management using Secrets in nginx
Support for websocket port in nginx
2017-06-06 10:01:53 +02:00
krish7919 (Krish)
af966f56df Credential management using Secret in nginx_3scale 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
cf10d3199e Support for TLS connections in MongoDB StatefulSet 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
06f0f8d95e Support for TLS connections in MongoDB Monitoring Agent 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
ff12d0aafc Support for TLS connections in MongoDB Backup Agent 2017-06-06 10:01:53 +02:00
krish7919 (Krish)
7208310111 Global ConfigMap and Secret 2017-06-06 10:01:53 +02:00
Troy McConaghy
818d44052e python cleanup of analyze.py 2017-05-24 15:15:12 +02:00
Troy McConaghy
8f6e7fc735 added little py script to do some nginx logs analysis 2017-05-24 15:02:06 +02:00
Krish
710fde686d Update bigchaindb default deployment version
Updated to the latest release, version 0.10.2.
2017-05-22 14:22:16 +02:00
Krish
b6ec3e5f5c Mongodb TLS (#1456)
* Support for secure TLS communication in MongoDB, MongoDB Monitoring
Agent and MongoDB Backup Agent
- Move from Golang to Bash for entrypoint program
- Update image tag to 2.0 for Backup and Monitoring Agents and to
3.4.4 for MongoDB
- Add documentation

* changed title & rewrote Step 1 of workflow.rst

* copy-edited ca-installation.rst

* copy-edited & modified structure of workflow.rst

* moved repeated Easy-RSA install & config docs to new page

* edited the sentences describing the Easy-RSA dirs

* copy-edited the page about generating server certificate

* copy-edited the page about generating client certificate

* renamed page to 'How to Set Up a Self-Signed Certificate Authority'

* copy-edited page about how to revoke a certificate

* Comments on how to uniquely name all instances in the cluster

* Added comments about the other questions when setting up a CA

* Added note about one Agent Api Key per Cloud Manager backup

* docs: clarified instructions for generating server CSR

* docs: added back 'from your PKI infrastructure'

* docs: fixed step & added step re/ FQDNs & certs in workflow.rst

* docs: added note re/ the Distinguished Name

* Update docs for env vars setup

* docs: added tip: how to get help with the easyrsa command
2017-05-19 11:18:44 +02:00
krish7919 (Krish)
b8407d603a Deploy events API on k8s over on HTTP 2017-05-16 10:38:40 +02:00
Krish
07a9e69933 WebSocket support in NGINX (#1439)
* Open port in Dockerfile
* Added the BIGCHAINDB_WS_FRONTEND_PORT and BIGCHAINDB_WS_BACKEND_PORT as parameters.
2017-05-02 12:20:27 +02:00
Krish
43f9f67867 Publish port 80 publicly in nginx-3scale. (#1446)
Upgrade docker image tag to `1.1` as the corresponding config changes for displaying error message are built in the `1.1` container image.
2017-04-28 10:14:14 +02:00
Krish
20270cdb9b Config settings for MongoDB Backup Agent (#1442) 2017-04-26 18:34:22 +02:00
Sylvain Bellemare
22f0e25c9a Correct JSON 2017-04-25 11:58:15 +02:00
Sylvain Bellemare
43ac369e45 Move oms related files under dedicated dir 2017-04-25 11:58:15 +02:00
Sylvain Bellemare
920d4aa181 Add log analytics oms deployment scripts 2017-04-25 11:58:15 +02:00
Krish
cc66d5aaa5 Single node setup (#1418)
* Add more tools to the toolbox container

* Add mongodb monitoring agent
* Add a bigchaindb/mongodb-monitoring-agent container that includes the
monitoring agent.
* It makes use of an api key provided by MongoDB Cloud Manager. This is
included in the configuration/config-map.yaml file.

* Changes to mongodb StatefulSet configuration
Changes to bump up mongodb version to v3.4.3.
Add configuration settings for mongodb instance name in ConfigMap.
Split the mongodb service to a new configuration file.

* Modify bigchaindb deployment config
* Bugfix to remove keyring field for the first node.
* Split the mongodb service to a new configuration file.

* Add mongodb backup agent
* Add a bigchaindb/mongodb-backup-agent container that includes the
backup agent.
* It makes use of an api key provided by MongoDB Cloud Manager. This is
included in the configuration/config-map.yaml file.

* Changes to nginx deployment config
* Allow 'all' by default for now. This is included in the
configuration/config-map.yaml file.
* Dynamically resolve DNS addresses of our backend services; cache DNS
resolution for 20s.
* Configure DNS based on user provided resolver. This helps in user
deciding to provide 8.8.8.8 or a custom DNS for name resolution. For k8s
deployments, we use the hardcoded k8s DNS IP of 10.0.0.10.

* Changes to nginx-3scale deployment config
* Use the common ConfigMap in configuration/config-map.yaml file.

* Removing prefix `v` from the docker tag for mongodb-monitoring-agent and mongodb containers

* Bumping up version for nginx-3scale container

* Add small helper scripts for docker build and push of mongodb monitoring
and backup agents

* Documentation for setting up the first node with monitoring and backup
agents
2017-04-21 14:41:12 +02:00
Krish
28042a7e83 Add NGINX integration with 3scale on Kubernetes (#1392)
* Add NGINX integration with 3scale on Kubernetes
2017-04-13 17:34:25 +02:00
Krish
425397f644 NGINX frontend for MongoDB and BigchainDB (#1304)
- Added NGINX deployment to frontend both BDB and MDB.
- Nginx is configured with a whitelist (which is read from a ConfigMap)
to allow only other MDB nodes in the closter to communicate with it.
- Azure LB apparently does not support proxy protocol and hence
whitelisting fails as nginx always observer the LB IP instead of the
real IP in the TCP stream.
- Whitelisting source IPs for MongoDB
- Removing deprecated folder
- Better log format
- Intuitive port number usage
- README and examples
- Addressed a typo in PYTHON_STYLE_GUIDE.md
- Azure LB apparently does not support proxy protocol and hence
whitelisting fails as nginx always observer the LB IP instead of the
real IP in the TCP stream.
- Whitelisting source IPs for MongoDB
- Removing deprecated folder
- Multiple changes:
- Better log format
- Intuitive port number usage
- README and examples
- Addressed a typo in PYTHON_STYLE_GUIDE.md
- Documentation
- add the k8s directory to the ignore list in codecov.yml
2017-03-22 14:25:25 +01:00
Krish
ea6ce5c1a1 Single node/cluster bootstrap and node addition workflow in k8s (#1278)
* Combining configs
*  Combining the persistent volume claims into a single file.
*  Combining the storage classes into a single file.

* Updating documentation

* Multiple changes
*  Support for ConfigMap
*  Custom MongoDB container for BigchainDB
*  Update documentation to run a single node on k8s

* Additional documentation

* Documentation to add a node to an existing BigchainDB cluster

* Commit on rolling upgrades

* Fixing minor documentation mistakes

* Documentation updates as per @ttmc's comments

* Block formatting error

* Change in ConfigMap yaml config
2017-03-15 16:22:49 +01:00
Troy McConaghy
e0366468ec Fix comments in bigchaindb/toolbox Dockerfile
The comments were referring to another Docker image (`krish7919/toolbox`).
2017-03-13 18:14:18 +01:00
Krish
7dbd374838 Running a single node on k8s (#1269)
* Single node as a StatefulSet in k8s
- uses bigchaindb/bigchaindb:0.9.1

* Updating README

* rdb, mdb as stateful services

* [WIP] bdb as a statefulset

* [WIP] bdb w/ rdb and bdb w/ mdb backends
- does not work as of now

* Split mdb & bdb into separate pods + enhancements
*  discovery of the mongodb service by the bdb pod by using dns name.
*  using separate storage classes to map 2 different volumes exposed by the
mongo docker container; one for /data/db (dbPath) and the other for
 /data/configdb (configDB).
*  using the `persistentVolumeReclaimPolicy: Retain` in k8s pvc. However,
this seems to be unsupported in Azure and the disks still show a reclaim
policy of `delete`.
*  mongodb container runs the `mongod` process as user `mongodb` and group
`mongodb. The corresponding `uid` and `gid` for the `mongod` process is 999
and 999 respectively. When the constinaer runs on a host with a mounted disk,
the writes fail, when there is no user with uid 999. To avoid this, I use the
docker provided feature of --cap-add=FOWNER in k8s. This bypasses the uid and
gid permission checks during writes and allows writes.
Ref: https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities

* Delete redundant k8s files, add cluster deletion steps.

* Single node as a StatefulSet in k8s
- uses bigchaindb/bigchaindb:0.9.1

* Updating README

* rdb, mdb as stateful services

* [WIP] bdb as a statefulset

* [WIP] bdb w/ rdb and bdb w/ mdb backends
- does not work as of now

* Split mdb & bdb into separate pods + enhancements
*  discovery of the mongodb service by the bdb pod by using dns name.
*  using separate storage classes to map 2 different volumes exposed by the
mongo docker container; one for /data/db (dbPath) and the other for
 /data/configdb (configDB).
*  using the `persistentVolumeReclaimPolicy: Retain` in k8s pvc. However,
this seems to be unsupported in Azure and the disks still show a reclaim
policy of `delete`.
*  mongodb container runs the `mongod` process as user `mongodb` and group
`mongodb. The corresponding `uid` and `gid` for the `mongod` process is 999
and 999 respectively. When the constinaer runs on a host with a mounted disk,
the writes fail, when there is no user with uid 999. To avoid this, I use the
docker provided feature of --cap-add=FOWNER in k8s. This bypasses the uid and
gid permission checks during writes and allows writes.
Ref: https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities

* Delete redundant k8s files, add cluster deletion steps.

* Documentation: running a single node with distinct mongodb and bigchaindb
pods on k8s

* Updates as per @ttmc's comments
2017-03-09 16:53:00 +01:00
Troy McConaghy
880729cac2 minor changes to 2 yml files + added RDB intracluster port 2017-03-05 16:47:12 +01:00
krish7919 (Krish)
93d06b4e2a PVC for MDB in single BDB+MDB StatefulSet 2017-03-04 20:05:30 +01:00
krish7919 (Krish)
b9e5bc84d9 Merge branch 'k8s-node' of github.com:bigchaindb/bigchaindb into local-k8s-node 2017-03-03 17:35:16 +01:00
krish7919 (Krish)
43284798fe Run bdb:latest with mongodb:3.4.1 as separate containers in the same pod 2017-03-03 17:34:50 +01:00
Troy McConaghy
e1d7f95a8c Switch to PVC for RDB in single BDB+RDB StatefulSet 2017-03-03 15:57:35 +01:00
Troy McConaghy
30db8a4e30 Renamed 'bdb091-server' to 'bdb-server' 2017-03-03 14:20:43 +01:00
krish7919 (Krish)
9228e69355 Run bdb:latest with rdb:2.3 as separate containers in the same pod 2017-03-03 12:07:49 +01:00
krish7919 (Krish)
64f4afb7ad Run bdb v0.9.1 as a pod in k8s 2017-03-03 10:19:09 +01:00