sorted out inbox

36 files changed, 186 insertions, 0 deletions

diff --git a/.trash/2024-01-08.md b/.trash/2024-01-08.md
new file mode 100644
index 0000000..7e480af
--- /dev/null
+++ b/.trash/2024-01-08.md
@@ -0,0 +1,16 @@
+---
+tags:
+  - qemu
+  - qemu-guest-agent
+  - backups
+---
+ot QEMU Guest agent working via booting a VM with an image after setting `hw_qemu_guest_agent='yes'` on that image.
+
+Put a script under `/etc/qemu/fsfreeze-hook.d/` with the executable flag set that echo's 'yo' when it is run.
+
+Tried Cinder backup: script not called
+Tried Cinder snapshot: script not called
+Tried Nova snapshot: script not called.
+
+---
+10.40 - 16.00
\ No newline at end of file
diff --git a/.trash/2024-01-09.md b/.trash/2024-01-09.md
new file mode 100644
index 0000000..9b3c874
--- /dev/null
+++ b/.trash/2024-01-09.md
@@ -0,0 +1,24 @@
+---
+tags:
+  - idea
+  - oslo_messaging
+  - tuning
+  - maintenance
+  - issue
+---
+ad an idea to develop a tool to parse openstack release pages to  see what's new from the CLI.
+
+Continued maintenance after making sure cold migrations do work on running VMs and make sure they are started again after migrating.
+
+Messaging timeouts occurred during maintenance. Found some settings to tune the neutron and nova oslo messaging library.
+https://docs.mirantis.com/mcp/q4-18/mcp-deployment-guide/advanced-config/tune-rabbitmq-perf.html
+
+Learned about the HAProxy ansible module:
+https://docs.ansible.com/ansible/latest/collections/community/general/haproxy_module.html
+
+We decided to add ansible  playbooks for enabling and disabling services. So we can disable the neutron controller in haproxy before restarting it. This prevents an issue where it is being flooded with requests while starting up and causing it to process SSL requests before even having loaded the SSL certificates.
+
+Forgot that I had to visit the mortgage advisor at the end of the afternoon.
+
+---
+9.30 - 16.00
diff --git a/.trash/2024-01-10.md b/.trash/2024-01-10.md
new file mode 100644
index 0000000..6a91cdb
--- /dev/null
+++ b/.trash/2024-01-10.md
@@ -0,0 +1,5 @@
+Maintenance had been stopped due to an hanging apt-lock on n40 vps2 compute. Killed the hanging process and resumed maintenance.
+
+
+---
+9.30
\ No newline at end of file
diff --git a/.trash/2024-02-20.md b/.trash/2024-02-20.md
new file mode 100644
index 0000000..2359685
--- /dev/null
+++ b/.trash/2024-02-20.md
@@ -0,0 +1,12 @@
+Building an OpenStack service.
+
+**Things to  look into**
+- Tox (testing I think)
+- Project structure
+- Conventions
+- Deployment considerations
+- https://opendev.org/openstack/requirements/
+
+**Tox**
+https://tox.wiki/en/4.13.0/
+Test automation and standardization.
\ No newline at end of file
diff --git a/.trash/2024-06-13.md b/.trash/2024-06-13.md
new file mode 100644
index 0000000..61a16ac
--- /dev/null
+++ b/.trash/2024-06-13.md
@@ -0,0 +1,2 @@
+Tests:
+-  
\ No newline at end of file
diff --git a/.trash/2024-06-17.md b/.trash/2024-06-17.md
new file mode 100644
index 0000000..144e133
--- /dev/null
+++ b/.trash/2024-06-17.md
@@ -0,0 +1,10 @@
+Investigated the last remaining error with a missing reply queue which was the likely suspect of some alerts of compute service down etc. After some digging in Kibana i noticed a compute node that was logging MessagingTimeouts. I restarted the compute service on this node and it seems to have resolved the errors.
+
+Both system test in CPH8 and LEJ1 were failing. CPH8 likely due to me restarting neutron-server earlier that morning in an attempt to fix the reply queue error.
+LEJ1 had been failing since 14th of June. My guess is due to some maintenance related issue. Both system tests are running smoothly again after cleaning up their artifacts.
+
+Meanwhile, maintenance on VPS1-LEJ1 is still on-going and causing headaches. Another password refresh of the access node caused a migration to fail during post-cleanup and I had to set the host and node of the instance to the correct node directly via MySQL. I should apply Rutgers' suggestion of saving some variables in the OS_\* env vars, rather sooner than later.
+
+Tested retention  backups  being scheduled, and deployed it to prod.
+
+Investigate whether we can listen for notifications by Nova so that we can listen for server deletions and remove them from periodic backups. There should be no need to delete backups for the server, as the retention policy will have them deleted after a while.
\ No newline at end of file
diff --git a/.trash/2024-06-26.md b/.trash/2024-06-26.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/2024-06-26.md
diff --git a/.trash/2024-08-21.md b/.trash/2024-08-21.md
new file mode 100644
index 0000000..cf7a783
--- /dev/null
+++ b/.trash/2024-08-21.md
@@ -0,0 +1,20 @@
+eed to start learning to take notes consistently. My idea now, to kick-off this process, is to open a daily note in obsidian every day at the start of the day in which I will keep crude, quick notes.
+Then at the end of the day I shall take some time to go over the notes and refine them. Not yet sure if that refinement will already be the end result or if i should go over refined notes again at maybe the end of each week to see if they really stick.
+I should commit notes to git to save them.
+
+
+
+Don't forget to always read man pages. Maybe I should create a detailed note about how to use man pages.
+
+I will start going to the office full-time from now on.
+I should make sure my Obsidian notes and taskwarrior tasks are kept safely in a git repo in case i lose my laptop.l
+
+
+
+I should ask for a diagram of the current systems and take note of it, e.g what is OneCRM / OneHOP / OneHome and all that.
+
+To upgrade a single package using apt we can use `apt-get install --only-upgrade <packagename>`.
+
+Need to "relearn" to design stuff and document it.
+
+Designing structures and a mechanism to return and store info about individual disk backups, we can send that as parent when making incremental backups. Currently we fetch parent reference from checkpoint, which in case of volume's doesn't work of course. It also breaks if, on the testpod, we reset all backups etc but dont do so with all checkpoints.
\ No newline at end of file
diff --git a/.trash/2024-08-22.md b/.trash/2024-08-22.md
new file mode 100644
index 0000000..a591d25
--- /dev/null
+++ b/.trash/2024-08-22.md
@@ -0,0 +1,4 @@
+Woke up full of motivation to go to the office. Asked my honey if it's okay to join her by train "is there enough time left?", "yeah" she replied. Then when I come downstairs and she asks me if I can be fast, I tell her maybe it's better you go then bc i worry I will not be able to. Right away she storms off mad and angry... My motivation gone, so I'll work from home..
+
+Went to the office anyway by motorcycle, cannot feel like I'm waking up when staying at home anymore.
+
diff --git a/.trash/2024-08-23.md b/.trash/2024-08-23.md
new file mode 100644
index 0000000..6f41ca2
--- /dev/null
+++ b/.trash/2024-08-23.md
@@ -0,0 +1,6 @@
+Discussed about Automatic Evac (HA). We were unsure about what to do when a local storage goes down. Do we restore the instances from backups to a new node? In that case a DB server might lose important transtactions. So we could also wait until it is fixed.
+
+Would like Rutger to explain the Freenet BGP load balancing setup in more detail. How do the routers work, what are all those interfaces attached to them?
+
+A local storage disk backup is stored as a QCOW2 image. An incremental has a relationship to its parent, because they neged to be rebased onto each other.
+A volume disk backup is stored as raw data and is accompanied by a file of checksums per block. The extra file is used both to track dirtied blocks for incremental backup.
\ No newline at end of file
diff --git a/.trash/2024-08-26.md b/.trash/2024-08-26.md
new file mode 100644
index 0000000..a91a1c9
--- /dev/null
+++ b/.trash/2024-08-26.md
@@ -0,0 +1 @@
+Nothing of note
\ No newline at end of file
diff --git a/.trash/2024-08-27.md b/.trash/2024-08-27.md
new file mode 100644
index 0000000..eb75d3f
--- /dev/null
+++ b/.trash/2024-08-27.md
@@ -0,0 +1,11 @@
+Changed a few things in the backup service:
+* No longer delete all checkpoints when we make a full backup
+	* TODO: make sure we delete the checkpoint corresponding to a backup when the backup is deleted.
+	* TODO: Gracefully handle all checkpoints being deleted by openstack
+* No longer explicitly specify "incremental" bool, just make it a best effort attempt.
+	* Still need to work out restores
+
+
+When can we reboot n01.compute vps1-cph8. Its uptime is already 300 days.
+
+Short call with Jakub. Their priorities have shifted again, the focus on backup will be moved to improving performance of OneHome. They plan to synchronize data from OpenStack to OneHome so they can serve it faster. He asked me whether the customer can influence OpenStack state from within their VM. I told him that probably the only thing they can do to influence OpenStack is shutdown their VM.
\ No newline at end of file
diff --git a/.trash/2024-08-28.md b/.trash/2024-08-28.md
new file mode 100644
index 0000000..ac0cac1
--- /dev/null
+++ b/.trash/2024-08-28.md
@@ -0,0 +1 @@
+Had a meeting about onehome performance, they query everything in existence for a customer because of their graphQL workflow. they want to now sync everything in existence to a table so their gQL is fast again.
\ No newline at end of file
diff --git a/.trash/2024-08-29.md b/.trash/2024-08-29.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/2024-08-29.md
diff --git a/.trash/2024-09-03.md b/.trash/2024-09-03.md
new file mode 100644
index 0000000..1d8a68e
--- /dev/null
+++ b/.trash/2024-09-03.md
@@ -0,0 +1 @@
+one on one Rutger;
diff --git a/.trash/2024-09-10.md b/.trash/2024-09-10.md
new file mode 100644
index 0000000..07ff5ba
--- /dev/null
+++ b/.trash/2024-09-10.md
@@ -0,0 +1 @@
+EYQBGNF95VORXXVVJ6NKFZF expressVPN
\ No newline at end of file
diff --git a/.trash/2024-09-30.md b/.trash/2024-09-30.md
new file mode 100644
index 0000000..fef578b
--- /dev/null
+++ b/.trash/2024-09-30.md
@@ -0,0 +1 @@
+- Check freenetvps gobs
\ No newline at end of file
diff --git a/.trash/2024-10-02.md b/.trash/2024-10-02.md
new file mode 100644
index 0000000..64c611f
--- /dev/null
+++ b/.trash/2024-10-02.md
@@ -0,0 +1,6 @@
+* Fixed n06 testpod, due to installing stuff via pip we had some conflicting packages being used. Pip has been purged and stuff seems to work normally now.
+* Investigated DNS issues on testpod lb with Erik.
+* Fixed some small issues in the backup service
+	* Deleted servers couldn't be removed from the periodic backup, that is now fixed.
+	* Less noisy logging by moving some stuff to debug level.
+* Deployed image_id change to prod
\ No newline at end of file
diff --git a/.trash/2024-10-04.md b/.trash/2024-10-04.md
new file mode 100644
index 0000000..9c77b37
--- /dev/null
+++ b/.trash/2024-10-04.md
@@ -0,0 +1,26 @@
+What is needed to recreate a deleted server:
+* name
+* description
+* block device mapping
+* image properties
+	*  while restoring we need to somehow schedule according to image properties, e.g os_type, or is this already resolved by selecting the correct AZ?
+	* volumes need to clone volume_image_properties
+* port mapping
+* availability zone
+* flavor
+* propertieskjk
+
+
+
+port
+* name
+* description
+* allowed_address_pairs
+* dns_domain
+* dns_name
+* extra_dhcp_opts
+* fixed_ips
+* is_port_security_enabled
+* security_group_ids
+* qos_policy_id
+* network_id
\ No newline at end of file
diff --git a/.trash/2024-10-15.md b/.trash/2024-10-15.md
new file mode 100644
index 0000000..8887a01
--- /dev/null
+++ b/.trash/2024-10-15.md
@@ -0,0 +1,3 @@
+Reminder: 
+* write SOP for fix_allocation
+* write SOP for fixing duplicate connector
\ No newline at end of file
diff --git a/.trash/2024-11-11.md b/.trash/2024-11-11.md
new file mode 100644
index 0000000..5f3eedb
--- /dev/null
+++ b/.trash/2024-11-11.md
@@ -0,0 +1,3 @@
+Sqlalchemy/mysql connections lijken een timeout te hitten 
+zie:
+`https://kibana.one.com/s/openstack/app/discover#/?_g=(filters:!(),refreshInterval:(pause:!t,value:60000),time:(from:now-7d%2Fd,to:now))&_a=(columns:!(),dataSource:(dataViewId:d80a7401-b1fd-43b2-bdfc-79dffb0e8b15,type:dataView),filters:!(),hideChart:!f,interval:auto,query:(language:kuery,query:%22cb3204fa-208f-4b90-95a0-846a9e13852b%22),sort:!(!('@timestamp',desc)))`
diff --git a/.trash/2024-11-12.md b/.trash/2024-11-12.md
new file mode 100644
index 0000000..e48d53f
--- /dev/null
+++ b/.trash/2024-11-12.md
@@ -0,0 +1,3 @@
+Prometheus:
+- scrape config: `roles/prometheus/onecom-prometheus-scrape-config-*.json`
+- 
\ No newline at end of file
diff --git a/.trash/ELF (files).md b/.trash/ELF (files).md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/ELF (files).md
diff --git a/.trash/Group.ONE Backup Service.md b/.trash/Group.ONE Backup Service.md
new file mode 100644
index 0000000..ebb2c92
--- /dev/null
+++ b/.trash/Group.ONE Backup Service.md
@@ -0,0 +1,6 @@
+# Ubiquitous language
+**Project** The customer or tenant that owns the servers, backups and periodic backups.
+**Server** Is the subject of a backup or periodic backup. It has one or more disks assigned.
+**Disk** Can either be a local storage disk or shared storage volume. It is attached to a server and can be referenced by its name.
+**Backup** Is a snapshot in time of a server. It can be used to restore a server to how it was exactly at that moment in time.
+**PeriodicBackup** Is a group of servers that will be backed up periodically. 
\ No newline at end of file
diff --git a/.trash/Neutron DNS & Designate.md b/.trash/Neutron DNS & Designate.md
new file mode 100644
index 0000000..48785ab
--- /dev/null
+++ b/.trash/Neutron DNS & Designate.md
@@ -0,0 +1,3 @@
+https://docs.openstack.org/neutron/latest/admin/config-dns-int.html#config-dns-int
+
+Lijkt er op dat dns_domain overruled kan worden op port niveau.
\ No newline at end of file
diff --git a/.trash/Nix Flakes.md b/.trash/Nix Flakes.md
new file mode 100644
index 0000000..212281e
--- /dev/null
+++ b/.trash/Nix Flakes.md
@@ -0,0 +1,5 @@
+nix 
+
+
+
+--- 
diff --git a/.trash/Nixpkgs Overlays.md b/.trash/Nixpkgs Overlays.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/Nixpkgs Overlays.md
diff --git a/.trash/Nova Scheduler.md b/.trash/Nova Scheduler.md
new file mode 100644
index 0000000..1f58400
--- /dev/null
+++ b/.trash/Nova Scheduler.md
@@ -0,0 +1,2 @@
+Applies Filters to filters compute hosts that are not usable until a list remains of usable compute hosts.
+Filters have different costs, thus it's a good idea to put lightweight filters first as to reduce the load on the heavyweight ones.
\ No newline at end of file
diff --git a/.trash/Ruby gems nixpkgs.md b/.trash/Ruby gems nixpkgs.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/Ruby gems nixpkgs.md
diff --git a/.trash/Shell.nix python.md b/.trash/Shell.nix python.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/Shell.nix python.md
diff --git a/.trash/Timings VPS.md b/.trash/Timings VPS.md
new file mode 100644
index 0000000..51857df
--- /dev/null
+++ b/.trash/Timings VPS.md
@@ -0,0 +1,4 @@
+10 VPS: avg ms over 100 reqs: 225 ms
+20 VPS: first request: 247 ms. avg ms over 100 reqs: 203 ms
+50 VPS: first request: 259 ms. avg ms over 100 reqs: 220 ms
+101 VPS: first request: 264 ms. avg ms over 100 reqs: 221 ms
diff --git a/.trash/Updates ansible ad-hoc.md b/.trash/Updates ansible ad-hoc.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/Updates ansible ad-hoc.md
diff --git a/.trash/Zoner Migration.md b/.trash/Zoner Migration.md
new file mode 100644
index 0000000..dc61370
--- /dev/null
+++ b/.trash/Zoner Migration.md
@@ -0,0 +1 @@
+* Kernel installation
\ No newline at end of file
diff --git a/.trash/elixir - modules.md b/.trash/elixir - modules.md
new file mode 100644
index 0000000..e69de29
--- /dev/null
+++ b/.trash/elixir - modules.md
diff --git a/.trash/intro.md b/.trash/intro.md
new file mode 100644
index 0000000..5204005
--- /dev/null
+++ b/.trash/intro.md
@@ -0,0 +1,7 @@
+# Foundational document
+This document outlines the basis of my note taking system and serves mostly as a reminder to myself.
+
+I want to train the skill of effective note taking as I believe that it will serve as a foundation
+to any other study and will boost my overall productivity.
+
+
diff --git a/.trash/para.md b/.trash/para.md
new file mode 100644
index 0000000..c44b5b7
--- /dev/null
+++ b/.trash/para.md
@@ -0,0 +1,2 @@
+# PARA method
+