Add observability stack with Grafana, Prometheus, Loki, and cAdvisor

- Introduced a new Grafana dashboard for monitoring Docker containers using cAdvisor.
- Created provisioning files for Grafana dashboards and data sources.
- Added Dockerfiles and configuration files for Loki and Prometheus.
- Implemented a Docker Compose stack for the observability services.
- Configured Traefik as a reverse proxy for the services with appropriate routing.
- Added scripts for SSH tunneling to access the telemetry dashboard.
- Included secrets management for Grafana admin credentials.

observability/loki/loki-config.yaml

@@ -0,0 +1,51 @@
+auth_enabled: false
+
+# https://grafana.com/docs/loki/latest/configure/#common
+server:
+  http_listen_port: 3100
+  grpc_listen_port: 9096
+  log_level: info # options: debug, info, warn, error
+  grpc_server_max_concurrent_streams: 1000
+
+# https://grafana.com/docs/loki/latest/configure/#common
+common:
+# Loki is composed of multiple microservices that communicate with each other (gRPC).
+# The `instance_addr` is the address each microservice uses for inter-service communication.
+# We use the [monolithic mode](https://grafana.com/docs/loki/latest/get-started/deployment-modes/#monolithic-mode) for simplicity.
+# Therefore, we set the address to 127.0.0.1 so services can communicate with each other,
+# even when the container IP changes during upgrades.
+  instance_addr: 127.0.0.1
+  path_prefix: /loki
+  replication_factor: 1
+  ring:
+    kvstore:
+      store: inmemory
+  storage:
+    filesystem:
+      chunks_directory: /loki/chunks
+      rules_directory: /loki/rules
+
+schema_config:
+  configs:
+    - from: 2025-01-01
+      store: tsdb
+      object_store: filesystem
+      schema: v13
+      index:
+        prefix: index_
+        period: 24h
+
+frontend:
+  encoding: protobuf
+# By default, Loki will send anonymous, but uniquely-identifiable usage and configuration
+# analytics to Grafana Labs. These statistics are sent to https://stats.grafana.org/
+#
+# Statistics help us better understand how Loki is used, and they show us performance
+# levels for most users. This helps us prioritize features and documentation.
+# For more information on what's sent, look at
+# https://github.com/grafana/loki/blob/main/pkg/analytics/stats.go
+# Refer to the buildReport method to see what goes into a report.
+#
+# If you would like to disable reporting, uncomment the following lines:
+#analytics:
+#  reporting_enabled: false