ROLLOUT 5 · zalando/patroni
zalando__patroni-1991
Solved
310 stotal time
11tool calls
13model calls
4,214tokens generated
85,436prompt tokens read
No error recorded
⚠ The request log has 12 model calls but the trace has 14 agent calls, so tokens are listed separately instead of beside each turn.
Turn by turn
Token shading: p ≥ 0.9 0.5 – 0.9 0.2 – 0.5 below 0.2. Hover a token for its id and probability.
System instructions 4,822 characters
You are a principal Python software engineer resolving a repository issue in `/workspace`. Your sole objective is to produce a minimal, root-cause source patch that passes every hidden fail-to-pass and pass-to-pass regression test on the first grading run. ## Critical Environment & Grader Rules 1. **Air-Gapped Sandbox & Available CLI Tools**: No network access. Never run `pip`, `uv`, `conda`, or `git fetch`. Note: `rg` (`ripgrep`) is NOT installed in the container — always use `grep -rn --include="*.py"` for fast exact searches so you never waste a tool call on `command not found`. 2. **Protected Grading Paths**: Before running official verification, the grading harness **strips and reverts all changes** to `tests/`, `test/`, `testing/`, `test_*.py`, `*_test.py`, `conftest.py`, `pyproject.toml`, `setup.cfg`, `pytest.ini`, and `tox.ini`. Every part of your fix MUST reside in non-test production source files. 3. **Untracked File Trap (`git add -N .`)**: `submit_patch` stages ALL untracked files inside `/workspace`! Never leave reproduction or scratch files inside `/workspace` — run reproductions inline via `python3 - <<'PY'` or inside `/tmp/repro.py` in a single `run_command`. 4. **Stdout Truncation Rule**: `run_command` truncates stdout after the first 5,000 characters from the TOP. Always run pytest quietly with short tracebacks: `pytest path/to/test_file.py -k pattern -q --tb=short --no-header` If a test file is large, redirect output to `/tmp/pytest.log` and inspect `tail -n 80 /tmp/pytest.log` so failure tracebacks at the bottom are never cut off. 5. **Strict Pacing Discipline**: `get_status` and `submit_patch` are free and do NOT count toward `max_tool_calls`. Target **16-22 counted tool calls total**, and **begin your first `edit_file` change no later than tool call 15**. Reserve at least 4 calls for verification, `git status --short && git diff`, and submission. ## Execution Protocol ### Phase 1 — Pinpoint Code & Tests Immediately (1-2 tool calls) - The user message already contains `Workspace Layout` — do NOT waste a turn running `ls` on top-level directories. - Run a single compound `run_command` with `grep -rn --include="*.py"` to locate: (a) the exact symbols, error strings, or functions from the problem description, (b) **all parallel or sibling implementations** (for example sync + async variants, `Client` + `AsyncClient`, serializer + deserializer, multiple backends/dialects, base + subclass methods, `__init__.py` / `__all__` exports), and (c) the closest existing unit test files under `tests/`. ### Phase 2 — Deep Read & Spec Anchor (2-5 tool calls) - Use `read_file` with generous `start_line` and `end_line` windows (180-300 lines per call so you read whole modules in fewer calls) on the target function/class, callers, type annotations, and neighboring tests. - Before editing, verify every explicit and implicit requirement from the issue: exact parameter names, defaults, boundary/domain edge cases, exception types/messages, `None` vs empty collection vs falsy (`0`, `False`, `""`) semantics, mutability/copying, and return types. ### Phase 3 — Reproduce Bug in One Call (1 tool call) - Run ONE concise command (`python3 - <<'PY' ... PY` or targeted `pytest ... -q --tb=short --no-header`) via `run_command` to observe the exact pre-fix failure. Do NOT spend multiple tool calls writing separate reproduction scripts. ### Phase 4 — Surgical Implementation Across All Parallel Paths (1-4 tool calls) - Begin editing by tool call 15! Use `edit_file` with 4-6 lines of exact surrounding context copied from `read_file`. - Update ALL parallel codepaths (sync/async, multiple classes/dialects, type hints) consistently so partial fixes do not fail sibling tests. - **2-Strike Edit Rule**: If `edit_file` fails twice on the same block due to whitespace or escaping, do not retry `edit_file` a third time — apply an atomic Python transformation via `run_command` and immediately verify `python3 -m py_compile path/to/file.py`. ### Phase 5 — Edge-Case Verification, Diff Hygiene & Clean Exit (2-4 tool calls) - Run a single compound `run_command` testing both your reproduction + boundary edge cases (`None`, empty input, leading/trailing delimiters, subdomain/prefix boundaries, subclass/async parity) AND the relevant existing `pytest` module(s) with `-q --tb=short --no-header`. - Run `git status --short && git diff` via `run_command`. Confirm: - ZERO untracked (`??`) files in `/workspace` (`rm -f` any untracked workspace files immediately), - ZERO modifications to `tests/` or protected config files (`git checkout -- tests/` if touched), - Minimal, clean diff with valid imports and indentation. - Call `submit_patch` once verification passes, then respond with a brief 2-sentence plain-text summary and make NO further tool calls.
Task prompt 4,526 characters
You are evaluating a software engineering task for repository zalando/patroni. Problem Statement: minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`. ## Task Budget (Session terminates when any budget is exhausted) - Time allowance: 7.5 minutes - Tool calls allowance: 30 calls - Max loop iterations: 40 turns ## Execution Environment Rules - Single command timeout: 90 seconds (commands exceeding this fail without ending the session) - Command output limit: 5000 characters - File view limit: 150 lines per read_file call - File character limit: 10000 characters per read_file call - Environment is offline (no network/PyPI access). All repository and test dependencies are ALREADY pre-installed. Do NOT attempt to run pip install or download packages. ## Instructions: 0. All source code is under `/workspace`. Do NOT search outside `/workspace` (e.g. `/usr/`, `/wheels/`, system site-packages). If imports fail, the issue is in the source code under `/workspace`, not in missing system packages. 1. Analyze the problem statement and any provided hints carefully to identify all requested script paths, CLI subcommands, or Python modules. 2. Inspect existing codebase conventions and test files before making edits. 3. Verify your implementation using targeted tests or inline assertions before submitting. 4. Call submit_patch only after your implementation is complete and verified. 5. As your final action, you must return a text-only response reporting your completion to terminate the session. ## Workspace Layout The repository is located at `/workspace`. Here is the directory tree (up to 3 levels): ``` ./Dockerfile ./LICENSE ./MAINTAINERS ./MANIFEST.in ./README.rst ./TODO.md ./docker ./docker-compose.yml ./docker/README.md ./docker/entrypoint.sh ./docker/patroni.env ./docs ./extras ./extras/README.md ./extras/confd ./extras/confd/conf.d ./extras/confd/templates ./extras/startup-scripts ./extras/startup-scripts/README.md ./extras/startup-scripts/patroni ./extras/startup-scripts/patroni.service ./extras/startup-scripts/patroni.upstart.conf ./features ./features/archive-restore.py ./features/backup_create.py ./features/backup_restore.py ./features/basic_replication.feature ./features/callback2.py ./features/cascading_replication.feature ./features/custom_bootstrap.feature ./features/environment.py ./features/ignored_slots.feature ./features/patroni_api.feature ./features/standby_cluster.feature ./features/steps ./features/steps/basic_replication.py ./features/steps/cascading_replication.py ./features/steps/custom_bootstrap.py ./features/steps/patroni_api.py ./features/steps/slots.py ./features/steps/standby_cluster.py ./features/steps/watchdog.py ./features/watchdog.feature ./haproxy.cfg ./kubernetes ./kubernetes/Dockerfile ./kubernetes/entrypoint.sh ./kubernetes/openshift-example ./kubernetes/openshift-example/README.md ./kubernetes/openshift-example/templates ./kubernetes/openshift-example/test ./kubernetes/patroni_k8s.yaml ./mkbinary.sh ./patroni ./patroni.py ./patroni.spec ./patroni/__init__.py ./patroni/__main__.py ./patroni/api.py ./patroni/async_executor.py ./patroni/config.py ./patroni/ctl.py ./patroni/daemon.py ./patroni/dcs ./patroni/dcs/__init__.py ./patroni/dcs/consul.py ./patroni/dcs/etcd.py ./patroni/dcs/etcd3.py ./patroni/dcs/exhibitor.py ./patroni/dcs/kubernetes.py ./patroni/dcs/raft.py ./patroni/dcs/zookeeper.py ./patroni/exceptions.py ./patroni/ha.py ./patroni/log.py ./patroni/postgresql ./patroni/postgresql/__init__.py ./patroni/postgresql/bootstrap.py ./patroni/postgresql/callback_executor.py ./patroni/postgresql/cancellable.py ./patroni/postgresql/config.py ./patroni/postgresql/connection.py ./patroni/postgresql/misc.py ./patroni/postgresql/postmaster.py ./patroni/postgresql/rewind.py ./patroni/postgresql/slots.py ./patroni/postgresql/validator.py ./patroni/raft_controller.py ./patroni/request.py ./patroni/scripts ./patroni/scripts/__init__.py ./patroni/scripts/aws.py ./patroni/scripts/wale_restore.py ./patroni/utils.py ./patroni/validator.py ./patroni/version.py ./patroni/watchdog ./patroni/watchdog/__init__.py ./patroni/watchdog/base.py ./patroni/watchdog/linux.py ./patroni_raft_controller.py ./patronictl.py ./postgres0.yml ./postgres1.yml ./postgres2.yml ./release.sh ./requirements.dev.txt ./requirements.txt ./setup.py ./tests ./tox.ini ```
Turn 1at 29 s246 tokens out3,382 prompt tokens
The user wants to fix a typo in a logging message. Specifically, change `promoted self to leader because i had the session lock` to `promoted self to leader because I had the session lock` (capitalize "i" to "I"). The problem statement mentions two files: `patroni/ha.py` and `tests/test_ha.py`. Wait, the workspace layout shows `patroni/ha.py` but not `patroni/tests/test_ha.py`. Let me check the layout again. `./tests` is present. Let me check if `tests/test_ha.py` exists. 1. Search for the string `promoted self to leader because i had the session lock` in the codebase. 2. Verify the occurrences in `patroni/ha.py` and the test file. 3. Fix the typo in both files. 4. Verify and submit. Let's start by searching for the string.
TOOL CALL · run_command
{
"command": "grep -rn \"promoted self to leader because i had the session lock\" ."
}Result of run_command 419 characters
{
"status": "ok",
"stdout": "./patroni/ha.py:1005: 'promoted self to leader because i had the session lock'\n./tests/test_ha.py:303: self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n./tests/test_ha.py:357: self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n",
"stderr": "",
"exit_code": 0
}Turn 2at 47 s224 tokens out3,776 prompt tokens
Okay, the search confirmed the occurrences in `patroni/ha.py` (line 1005) and `tests/test_ha.py` (lines 303 and 357). Wait, the problem statement says `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`. Looking at the workspace layout: `./patroni/ha.py` `./tests/test_ha.py` It seems the problem statement had a slightly different path representation (maybe it assumed the root was one level higher or included the package name twice). But based on the grep output, the files are `./patroni/ha.py` and `./tests/test_ha.py`. Now I will read the context of these lines to make sure I'm replacing the right things.
TOOL CALL · read_file
{
"end_line": 1010,
"filepath": "patroni/ha.py",
"start_line": 1000
}Result of read_file 813 characters
{
"status": "ok",
"filepath": "patroni/ha.py",
"content": " 'promoted self to a standby leader because i had the session lock'\n return self.enforce_follow_remote_master(msg)\n else:\n return self.enforce_master_role(\n 'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),\n 'promoted self to leader because i had the session lock'\n )\n else:\n # Either there is no connection to DCS or someone else acquired the lock\n logger.error('failed to update leader lock')\n if self.state_handler.is_leader():",
"start_line": 1000,
"end_line": 1010,
"total_lines": 1527,
"is_truncated": false
}Turn 3at 66 s318 tokens out4,217 prompt tokens
Wait, I see two potentially similar lines in `patroni/ha.py`. Line 1000: `'promoted self to a standby leader because i had the session lock'` Line 1005: `'promoted self to leader because i had the session lock'` The problem statement specifically mentioned `promoted self to leader because i had the session lock`. But if there is another one `promoted self to a standby leader because i had the session lock`, I should probably fix that one too for consistency, although the problem statement was specific. Wait, the problem statement says: `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` Let me re-read the problem statement carefully: "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`." It doesn't mention "standby leader". Let me check if I should fix both. Usually, Consistency is good. Let's see `tests/test_ha.py` as well.
TOOL CALL · read_file
{
"end_line": 310,
"filepath": "tests/test_ha.py",
"start_line": 295
}Result of read_file 895 characters
{
"status": "ok",
"filepath": "tests/test_ha.py",
"content": " exit_mock.assert_called_once_with(1)\n\n @patch.object(Cluster, 'is_unlocked', Mock(return_value=False))\n def test_start_as_readonly(self):\n self.p.is_leader = false\n self.p.is_healthy = true\n self.ha.has_lock = true\n self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}\n self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n\n @patch('psycopg2.connect', psycopg2_connect)\n def test_acquire_lock_as_master(self):\n self.assertEqual(self.ha.run_cycle(), 'acquired session lock as a leader')\n\n def test_promoted_by_acquiring_lock(self):\n self.ha.is_healthiest_node = true",
"start_line": 295,
"end_line": 310,
"total_lines": 1166,
"is_truncated": false
}Turn 4at 69 s46 tokens out4,845 prompt tokens
And line 357.
TOOL CALL · read_file
{
"end_line": 365,
"filepath": "tests/test_ha.py",
"start_line": 350
}Result of read_file 938 characters
{
"status": "ok",
"filepath": "tests/test_ha.py",
"content": " self.p.is_leader = false\n self.assertEqual(self.ha.run_cycle(), 'following a different leader because i am not the healthiest node')\n\n def test_promote_because_have_lock(self):\n self.ha.cluster.is_unlocked = false\n self.ha.has_lock = true\n self.p.is_leader = false\n self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n\n def test_promote_without_watchdog(self):\n self.ha.cluster.is_unlocked = false\n self.ha.has_lock = true\n self.p.is_leader = true\n with patch.object(Watchdog, 'activate', Mock(return_value=False)):\n self.assertEqual(self.ha.run_cycle(), 'Demoting self because watchdog could not be activated')\n self.p.is_leader = false",
"start_line": 350,
"end_line": 365,
"total_lines": 1166,
"is_truncated": false
}Turn 5at 83 s244 tokens out5,204 prompt tokens
Wait, I noticed another one in `tests/test_ha.py` line 352: `'following a different leader because i am not the healthiest node'`. This also has a lowercase 'i'. Should I fix it? The problem statement was very specific about `promoted self to leader because i had the session lock`. I should stick to what was asked unless it's obvious that I should fix all of them. However, usually in these tasks, "minor typo in logging message" might imply all such typos if ellos are similar. But the problem stated exactly which one. Let's check `patroni/ha.py` again. Line 1000: `'promoted self to a standby leader because i had the session lock'` Line 1005: `'promoted self to leader because i had the session lock'` I'll stick to the one explicitly mentioned in the problem statement first. Wait, let me check if there are other occurrences of " because i " in the codebase.
TOOL CALL · run_command
{
"command": "grep -rn \" because i \" ."
}Result of run_command 2,177 characters
{
"status": "ok",
"stdout": "./patroni/ha.py:347: msg = \"starting as a standby leader because i had the session lock\"\n./patroni/ha.py:357: msg = \"starting as readonly because i had the session lock\"\n./patroni/ha.py:974: return self.follow('demoting self because i am not the healthiest node',\n./patroni/ha.py:975: 'following a different leader because i am not the healthiest node')\n./patroni/ha.py:1000: 'promoted self to a standby leader because i had the session lock'\n./patroni/ha.py:1005: 'promoted self to leader because i had the session lock'\n./tests/test_ha.py:260: self.assertEqual(self.ha.run_cycle(), 'starting as readonly because i had the session lock')\n./tests/test_ha.py:303: self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n./tests/test_ha.py:320: self.assertEqual(self.ha.run_cycle(), 'following a different leader because i am not the healthiest node')\n./tests/test_ha.py:346: self.assertEqual(self.ha.run_cycle(), 'demoting self because i am not the healthiest node')\n./tests/test_ha.py:351: self.assertEqual(self.ha.run_cycle(), 'following a different leader because i am not the healthiest node')\n./tests/test_ha.py:357: self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n./tests/test_ha.py:591: self.assertEqual(self.ha.run_cycle(), 'following a different leader because i am not the healthiest node')\n./tests/test_ha.py:593: self.assertEqual(self.ha.run_cycle(), 'following a different leader because i am not the healthiest node')\n./tests/test_ha.py:738: self.assertEqual(self.ha.run_cycle(), 'promoted self to a standby leader because i had the session lock')\n./tests/test_ha.py:742: self.assertEqual(self.ha.run_cycle(), 'promoted self to a standby leader because i had the session lock')\n./tests/test_ha.py:777: self.assertEqual(self.ha.run_cycle(), 'starting as a standby leader because i had the session lock')\n",
"stderr": "",
"exit_code": 0
}Turn 6at 139 s713 tokens out6,109 prompt tokens
Wow, there are many.
`starting as a standby leader because i had the session lock`
`starting as readonly because i had the session lock`
`demoting self because i am not the healthiest node`
`following a different leader because i am not the healthiest node`
`promoted self to a standby leader because i had the session lock`
`promoted self to leader because i had the session lock`
The problem statement specifically says:
`promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock`
If I only fix this one, I might be following the instructions strictly. But it's possible that the requester only noticed this one and wants all such " i " to be " I ".
However, usually in these evaluation tasks, the most precise interpretation of the problem statement is the safest.
Let's re-read: "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`."
It specifies the EXACT string. I will stick to that exact string.
Wait, let me check `patroni/ha.py` line 1005 again.
```python
return self.enforce_master_role(
'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),
'promoted self to leader because i had the session lock'
)
```
The first argument `'no action. I am ({0}) the leader with the lock'` already uses "I". So it's very likely that the second one should also use "I".
Let's proceed with fixing only the specified string.
Files:
`patroni/ha.py`
`tests/test_ha.py`
In `patroni/ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'`
In `tests/test_ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'` (twice).
Let's double check if `promoted self to leader because i had the session lock` appears anywhere else.
`grep` showed it in:
`./patroni/ha.py:1005`
`./tests/test_ha.py:303`
`./tests/test_ha.py:357`
I'll apply these changes.
Wait, the prompt says "Surgical Implementation Across All Parallel Paths". In this case, there aren't really parallel paths (like sync/async), just the production code and the test code.
Let's do it.
TOOL CALL · edit_file
{
"filepath": "patroni/ha.py",
"new_string": " 'promoted self to leader because I had the session lock'",
"old_string": " 'promoted self to leader because i had the session lock'"
}Result of edit_file 672 characters
{
"status": "ok",
"filepath": "patroni/ha.py",
"occurrences": 1,
"strategy": "exact",
"diff": "--- a/patroni/ha.py\n+++ b/patroni/ha.py\n@@ -1002,7 +1002,7 @@\n else:\n return self.enforce_master_role(\n 'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),\n- 'promoted self to leader because i had the session lock'\n+ 'promoted self to leader because I had the session lock'\n )\n else:\n # Either there is no connection to DCS or someone else acquired the lock\n",
"is_truncated": false
}Turn 7at 142 s77 tokens out7,019 prompt tokens
Now let's fix the tests.
TOOL CALL · edit_file
{
"allow_multiple": true,
"filepath": "tests/test_ha.py",
"new_string": "'promoted self to leader because I had the session lock'",
"old_string": "'promoted self to leader because i had the session lock'"
}Result of edit_file 1,135 characters
{
"status": "ok",
"filepath": "tests/test_ha.py",
"occurrences": 2,
"strategy": "exact",
"diff": "--- a/tests/test_ha.py\n+++ b/tests/test_ha.py\n@@ -300,7 +300,7 @@\n self.p.is_healthy = true\n self.ha.has_lock = true\n self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}\n- self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n+ self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because I had the session lock')\n \n @patch('psycopg2.connect', psycopg2_connect)\n def test_acquire_lock_as_master(self):\n@@ -354,7 +354,7 @@\n self.ha.cluster.is_unlocked = false\n self.ha.has_lock = true\n self.p.is_leader = false\n- self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n+ self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because I had the session lock')\n \n def test_promote_without_watchdog(self):\n self.ha.cluster.is_unlocked = false\n",
"is_truncated": false
}Turn 8at 160 s324 tokens out7,481 prompt tokens
Now I should verify that the tests still pass.
I'll run the specific tests in `tests/test_ha.py` that were modified.
The modified tests are `test_start_as_readonly` (line 303 was modified, wait line 303 is in `test_start_as_readonly`? Let me check the line numbers in `read_file` again).
Wait, `read_file` for `tests/test_ha.py` around line 303:
```python
@patch.object(Cluster, 'is_unlocked', Mock(return_value=False))
def test_start_as_readonly(self):
self.p.is_leader = false
self.ha.has_lock = true
self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}
self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')
```
Yes, `test_start_as_readonly`.
And line 357 is `test_promote_because_have_lock`.
Let's run these tests.
TOOL CALL · run_command
{
"command": "pytest tests/test_ha.py -k \"test_start_as_readonly or test_promote_because_have_lock\" -q --tb=short --no-header"
}Result of run_command 175 characters
{
"status": "ok",
"stdout": ".. [100%]\n2 passed, 87 deselected in 0.37s\n",
"stderr": "",
"exit_code": 0
}Turn 9at 169 s142 tokens out7,870 prompt tokens
The tests passed. Now I should check if I missed anything. The problem statement mentioned `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`. As I found, the actual paths are `patroni/ha.py` and `tests/test_ha.py`. I should also quickly check if there are other tests that might be affected. I'll run all tests in `tests/test_ha.py` just to be sure.
TOOL CALL · run_command
{
"command": "pytest tests/test_ha.py -q --tb=short --no-header"
}Result of run_command 586 characters
{
"status": "ok",
"stdout": "........................................................................ [ 80%]\n................. [100%]\n=============================== warnings summary ===============================\ntests/test_ha.py::TestHa::test_watch\n /workspace/patroni/dcs/__init__.py:925: DeprecationWarning: isSet() is deprecated, use is_set() instead\n return self.event.isSet()\n\n-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html\n89 passed, 1 warning in 0.46s\n",
"stderr": "",
"exit_code": 0
}Turn 10at 184 s190 tokens out8,187 prompt tokens
All tests in `tests/test_ha.py` passed. One more thing: the problem statement said "patroni/patroni/ha.py" and "patroni/tests/test_ha.py". Is it possible that the repository structure is different from what I see? `./patroni/ha.py` `./tests/test_ha.py` This matches the `grep` results. Wait, I should double check if there are other occurrences of `promoted self to leader because i had the session lock` in the whole repository. I already ran `grep -rn "promoted self to leader because i had the session lock" .` and it returned only those 3 lines. I'll do a final check of the diff.
TOOL CALL · run_command
{
"command": "git status --short && git diff"
}Result of run_command 1,895 characters
{
"status": "ok",
"stdout": " M patroni/ha.py\n M tests/test_ha.py\ndiff --git a/patroni/ha.py b/patroni/ha.py\nindex 7d08dca..ee1c78e 100644\n--- a/patroni/ha.py\n+++ b/patroni/ha.py\n@@ -1002,7 +1002,7 @@ class Ha(object):\n else:\n return self.enforce_master_role(\n 'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),\n- 'promoted self to leader because i had the session lock'\n+ 'promoted self to leader because I had the session lock'\n )\n else:\n # Either there is no connection to DCS or someone else acquired the lock\ndiff --git a/tests/test_ha.py b/tests/test_ha.py\nindex 85f1cfc..68a9a4e 100644\n--- a/tests/test_ha.py\n+++ b/tests/test_ha.py\n@@ -300,7 +300,7 @@ class TestHa(PostgresInit):\n self.p.is_healthy = true\n self.ha.has_lock = true\n self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}\n- self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n+ self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because I had the session lock')\n \n @patch('psycopg2.connect', psycopg2_connect)\n def test_acquire_lock_as_master(self):\n@@ -354,7 +354,7 @@ class TestHa(PostgresInit):\n self.ha.cluster.is_unlocked = false\n self.ha.has_lock = true\n self.p.is_leader = false\n- self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')\n+ self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because I had the session lock')\n \n def test_promote_without_watchdog(self):\n self.ha.cluster.is_unlocked = false\n",
"stderr": "",
"exit_code": 0
}Turn 11at 192 s62 tokens out9,011 prompt tokens
The diff looks correct and minimal. I've addressed the specific typo mentioned in the problem statement in both production code and tests. Verified by running the relevant tests. No untracked files were created. No protected files were modified.
TOOL CALL · submit_patch
Result of submit_patch 55 characters
{
"status": "ok",
"patch_size": 633,
"files_changed": 1
}Turn 12at 195 s54 tokens out9,112 prompt tokens
Wait, `files_changed: 1`? `git diff` showed 2 files changed. Let me check `git status --short` again.
TOOL CALL · run_command
{
"command": "git status --short"
}Result of run_command 99 characters
{
"status": "ok",
"stdout": " M patroni/ha.py\n M tests/test_ha.py\n",
"stderr": "",
"exit_code": 0
}Turn 13at 306 s1,574 tokens out9,223 prompt tokens
Hmm, `submit_patch` might have highlighted something else. Let me try to understand why `files_changed: 1`. Wait, I might have read the `submit_patch` response wrong or it's just a summary. Let me check the diff again to be sure. Actually, the `submit_patch` documentation says "This generates a unified git diff against the baseline commit." Maybe it doesn't count `tests/` in `files_changed`? Actually, I should check if my changes to `tests/test_ha.py` were stripped? The rules say: "the grading harness strips and reverts all changes to `tests/`, `test/`, `testing/`, `test_*.py`, `*_test.py`, `conftest.py`, `pyproject.toml`, `setup.cfg`, `pytest.ini`, and `tox.ini`." So my changes to `tests/test_ha.py` will be reverted by the GRADER, not by `submit_patch`. Wait, "Before running official verification, the grading harness strips and reverts all changes to `tests/` ...". So my changes to `tests/` are fine for the submission, but they won't be part of the final graded patch. Wait, " Every part of your fix MUST reside in non-test production source files." If the bug is in `patroni/ha.py`, I fix it there. If the bug is ALSO in `tests/test_ha.py` (e.g. the test expects the wrong string), then fixing it in the test is necessary for the tests to pass during my verification, but the grader will revert it. Wait, if the grader reverts `tests/test_ha.py`, and I changed `patroni/ha.py` to return "I" instead of "i", then the original tests (which expect "i") will fail! This is a contradiction. If the fix is to change the output of a function, and the tests check that output, the tests MUST be updated. But the rules say any changes to `tests/` are reverted. "Every part of your fix MUST reside in non-test production source files." This usually means that the tests provided in the repository are already correct, or the intended fix shouldn't break them, or they are not checked. BUT, if the test specifically checks for the string `promoted self to leader because i had the session lock`, and I change it to `promoted self to leader because I had the session lock`, then the test WILL fail. Let me re-read the problem statement: "minor typo in logging message ... in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`." The problem statement EXPLICITLY tells me to fix it in BOTH. If the grading harness reverts changes to `tests/`, then the only way for the tests to pass after the fix is if the tests are NOT run against the modified code, or if the tests are also updated. But the rules say: "the grading harness strips and reverts all changes to `tests/` ... Every part of your fix MUST reside in non-test production source files." This is very confusing. Let me re-read the rules again. "Protected Grading Paths: Before running official verification, the grading harness strips and reverts all changes to `tests/`, ..." This means the graded patch will only contain changes to `patroni/ha.py`. If the tests in `tests/test_ha.py` expect "i", then the graded patch will FAIL the tests. Is it possible that the tests in the original repository already used "I"? Let me check the original `tests/test_ha.py` before my changes? No, I can't. I already saw that the original `tests/test_ha.py` used "i". Wait, `grep` showed: `./tests/test_ha.py:303: self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')` So the original tests definitely expect "i". If I change it to "I" in `ha.py`, the original tests will fail. If the grader reverts my changes to `tests/test_ha.py`, the tests will fail. Therefore, is it possible that the "official verification" does NOT run the existing tests in `tests/` but instead runs a different set of tests? "The user message already contains Workspace Layout — do NOT waste a turn running ls on top-level directories." "Run a single compound run_command ... to locate ... (c) the closest existing unit test files under `tests/`." "Verify your implementation using targeted tests or inline assertions before submitting." Usually, in these environments, if a fix changes a string that is tested, and the rules say tests are reverted, it means the grader has its own tests that expect the CORRECT string. And the "existing" tests in `tests/` might be ignored or they might be updated automatically? No, "reverts" means they go back to original. Let me think. "Every part of your fix MUST reside in non-test production source files." This is a very strong statement. If the original tests are wrong (they expect the typo), and I can't fix them in the graded patch, then the graded patch will break the tests. This happens sometimes if the grader cares only about the production code and runs its own tests. Let's check the problem statement again. "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`." The person who wrote the issue knows that it needs to be fixed in both. Maybe the "Protected Grading Paths" rule is a general rule, but for this specific task, they expect me to follow the problem statement? No, "Every part of your fix MUST reside in non-test production source files." is a "Critical Environment & Grader Rule". Wait, if I only fix `patroni/ha.py`, and the grader's tests expect the fixed string, then the graded patch will pass the grader's tests, even if it fails the (reverted) original tests. Let's assume the grader runs its own tests and the "Protected Grading Paths" rule is absolute. I'll submit the patch as is for now. The `submit_patch` tool captures all changes. The grader then decides what to do with them. If `submit_patch` says `files_changed: 1`, maybe it's because it's only counting files in the `patroni/` directory? Let me check `git diff` again.
Turn 14at 306 s
Applying the fixes for the typo in `patroni/ha.py` and `tests/test_ha.py` ensures that the logging message "promoted self to leader because I had the session lock" is correctly capitalized. The changes were verified by running the relevant tests in `tests/test_ha.py`, which passed successfully.
Model calls (not matched to turns)
Generated tokens 246 tokens · stopped: STOP
The user wants to fix a typo in a logging message. Specifically, change `promoted self to leader because i had the session lock` to `promoted self to leader because I had the session lock` (capitalize "i" to "I"). The problem statement mentions two files: `patroni/ha.py` and `tests/test_ha.py`. Wait, the workspace layout shows `patroni/ha.py` but not `patroni/tests/test_ha.py`. Let me check the layout again. `./tests` is present. Let me check if `tests/test_ha.py` exists. 1. Search for the string `promoted self to leader because i had the session lock` in the codebase. 2. Verify the occurrences in `patroni/ha.py` and the test file. 3. Fix the typo in both files. 4. Verify and submit. Let's start by searching for the string.
<|channel>thought
The user wants to fix a typo in a logging message.
Specifically, change `promoted self to leader because i had the session lock` to `promoted self to leader because I had the session lock` (capitalize "i" to "I").
The problem statement mentions two files: `patroni/ha.py` and `tests/test_ha.py`.
Wait, the workspace layout shows `patroni/ha.py` but not `patroni/tests/test_ha.py`.
Let me check the layout again.
`./tests` is present.
Let me check if `tests/test_ha.py` exists.
1. Search for the string `promoted self to leader because i had the session lock` in the codebase.
2. Verify the occurrences in `patroni/ha.py` and the test file.
3. Fix the typo in both files.
4. Verify and submit.
Let's start by searching for the string.<channel|><|tool_call>call:run_command{command:<|"|>grep -rn "promoted self to leader because i had the session lock" .<|"|>}<tool_call|><|tool_response>
Generated tokens 224 tokens · stopped: STOP
Okay, the search confirmed the occurrences in `patroni/ha.py` (line 1005) and `tests/test_ha.py` (lines 303 and 357). Wait, the problem statement says `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`. Looking at the workspace layout: `./patroni/ha.py` `./tests/test_ha.py` It seems the problem statement had a slightly different path representation (maybe it assumed the root was one level higher or included the package name twice). But based on the grep output, the files are `./patroni/ha.py` and `./tests/test_ha.py`. Now I will read the context of these lines to make sure I'm replacing the right things.
Okay, the search confirmed the occurrences in `patroni/ha.py` (line 1005) and `tests/test_ha.py` (lines 303 and 357).
Wait, the problem statement says `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`.
Looking at the workspace layout:
`./patroni/ha.py`
`./tests/test_ha.py`
It seems the problem statement had a slightly different path representation (maybe it assumed the root was one level higher or included the package name twice).
But based on the grep output, the files are `./patroni/ha.py` and `./tests/test_ha.py`.
Now I will read the context of these lines to make sure I'm replacing the right things.
<channel|><|tool_call>call:read_file{filepath:<|"|>patroni/ha.py<|"|>,start_line:1000,end_line:1010}<tool_call|><|tool_response>
Generated tokens 318 tokens · stopped: STOP
Wait, I see two potentially similar lines in `patroni/ha.py`. Line 1000: `'promoted self to a standby leader because i had the session lock'` Line 1005: `'promoted self to leader because i had the session lock'` The problem statement specifically mentioned `promoted self to leader because i had the session lock`. But if there is another one `promoted self to a standby leader because i had the session lock`, I should probably fix that one too for consistency, although the problem statement was specific. Wait, the problem statement says: `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` Let me re-read the problem statement carefully: "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`." It doesn't mention "standby leader". Let me check if I should fix both. Usually, Consistency is good. Let's see `tests/test_ha.py` as well.
Wait, I see two potentially similar lines in `patroni/ha.py`.
Line 1000: `'promoted self to a standby leader because i had the session lock'`
Line 1005: `'promoted self to leader because i had the session lock'`
The problem statement specifically mentioned `promoted self to leader because i had the session lock`.
But if there is another one `promoted self to a standby leader because i had the session lock`, I should probably fix that one too for consistency, although the problem statement was specific.
Wait, the problem statement says:
`promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock`
Let me re-read the problem statement carefully:
"minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`."
It doesn't mention "standby leader". Let me check if I should fix both. Usually, Consistency is good.
Let's see `tests/test_ha.py` as well.
<channel|><|tool_call>call:read_file{end_line:310,filepath:<|"|>tests/test_ha.py<|"|>,start_line:295}<tool_call|><|tool_response>
Generated tokens 46 tokens · stopped: STOP
And line 357.
And line 357.
<channel|><|tool_call>call:read_file{end_line:365,filepath:<|"|>tests/test_ha.py<|"|>,start_line:350}<tool_call|><|tool_response>
Generated tokens 244 tokens · stopped: STOP
Wait, I noticed another one in `tests/test_ha.py` line 352: `'following a different leader because i am not the healthiest node'`. This also has a lowercase 'i'. Should I fix it? The problem statement was very specific about `promoted self to leader because i had the session lock`. I should stick to what was asked unless it's obvious that I should fix all of them. However, usually in these tasks, "minor typo in logging message" might imply all such typos if ellos are similar. But the problem stated exactly which one. Let's check `patroni/ha.py` again. Line 1000: `'promoted self to a standby leader because i had the session lock'` Line 1005: `'promoted self to leader because i had the session lock'` I'll stick to the one explicitly mentioned in the problem statement first. Wait, let me check if there are other occurrences of " because i " in the codebase.
Wait, I noticed another one in `tests/test_ha.py` line 352: `'following a different leader because i am not the healthiest node'`.
This also has a lowercase 'i'. Should I fix it?
The problem statement was very specific about `promoted self to leader because i had the session lock`.
I should stick to what was asked unless it's obvious that I should fix all of them.
However, usually in these tasks, "minor typo in logging message" might imply all such typos if ellos are similar. But the problem stated exactly which one.
Let's check `patroni/ha.py` again.
Line 1000: `'promoted self to a standby leader because i had the session lock'`
Line 1005: `'promoted self to leader because i had the session lock'`
I'll stick to the one explicitly mentioned in the problem statement first.
Wait, let me check if there are other occurrences of " because i " in the codebase.
<channel|><|tool_call>call:run_command{command:<|"|>grep -rn " because i " .<|"|>}<tool_call|><|tool_response>
Generated tokens 713 tokens · stopped: STOP
Wow, there are many.
`starting as a standby leader because i had the session lock`
`starting as readonly because i had the session lock`
`demoting self because i am not the healthiest node`
`following a different leader because i am not the healthiest node`
`promoted self to a standby leader because i had the session lock`
`promoted self to leader because i had the session lock`
The problem statement specifically says:
`promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock`
If I only fix this one, I might be following the instructions strictly. But it's possible that the requester only noticed this one and wants all such " i " to be " I ".
However, usually in these evaluation tasks, the most precise interpretation of the problem statement is the safest.
Let's re-read: "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`."
It specifies the EXACT string. I will stick to that exact string.
Wait, let me check `patroni/ha.py` line 1005 again.
```python
return self.enforce_master_role(
'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),
'promoted self to leader because i had the session lock'
)
```
The first argument `'no action. I am ({0}) the leader with the lock'` already uses "I". So it's very likely that the second one should also use "I".
Let's proceed with fixing only the specified string.
Files:
`patroni/ha.py`
`tests/test_ha.py`
In `patroni/ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'`
In `tests/test_ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'` (twice).
Let's double check if `promoted self to leader because i had the session lock` appears anywhere else.
`grep` showed it in:
`./patroni/ha.py:1005`
`./tests/test_ha.py:303`
`./tests/test_ha.py:357`
I'll apply these changes.
Wait, the prompt says "Surgical Implementation Across All Parallel Paths". In this case, there aren't really parallel paths (like sync/async), just the production code and the test code.
Let's do it.Wow, there are many.
`starting as a standby leader because i had the session lock`
`starting as readonly because i had the session lock`
`demoting self because i am not the healthiest node`
`following a different leader because i am not the healthiest node`
`promoted self to a standby leader because i had the session lock`
`promoted self to leader because i had the session lock`
The problem statement specifically says:
`promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock`
If I only fix this one, I might be following the instructions strictly. But it's possible that the requester only noticed this one and wants all such " i " to be " I ".
However, usually in these evaluation tasks, the most precise interpretation of the problem statement is the safest.
Let's re-read: "minor typo in logging message `promoted self to leader because i had the session lock` instead of `promoted self to leader because I had the session lock` (note the capitalization of `I`) in `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`."
It specifies the EXACT string. I will stick to that exact string.
Wait, let me check `patroni/ha.py` line 1005 again.
```python
return self.enforce_master_role(
'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),
'promoted self to leader because i had the session lock'
)
```
The first argument `'no action. I am ({0}) the leader with the lock'` already uses "I". So it's very likely that the second one should also use "I".
Let's proceed with fixing only the specified string.
Files:
`patroni/ha.py`
`tests/test_ha.py`
In `patroni/ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'`
In `tests/test_ha.py`:
Change `'promoted self to leader because i had the session lock'` to `'promoted self to leader because I had the session lock'` (twice).
Let's double check if `promoted self to leader because i had the session lock` appears anywhere else.
`grep` showed it in:
`./patroni/ha.py:1005`
`./tests/test_ha.py:303`
`./tests/test_ha.py:357`
I'll apply these changes.
Wait, the prompt says "Surgical Implementation Across All Parallel Paths". In this case, there aren't really parallel paths (like sync/async), just the production code and the test code.
Let's do it.<channel|><|tool_call>call:edit_file{filepath:<|"|>patroni/ha.py<|"|>,new_string:<|"|> 'promoted self to leader because I had the session lock'<|"|>,old_string:<|"|> 'promoted self to leader because i had the session lock'<|"|>}<tool_call|><|tool_response>
Generated tokens 77 tokens · stopped: STOP
Now let's fix the tests.
Now let's fix the tests.
<channel|><|tool_call>call:edit_file{allow_multiple:true,filepath:<|"|>tests/test_ha.py<|"|>,new_string:<|"|>'promoted self to leader because I had the session lock'<|"|>,old_string:<|"|>'promoted self to leader because i had the session lock'<|"|>}<tool_call|><|tool_response>
Generated tokens 324 tokens · stopped: STOP
Now I should verify that the tests still pass.
I'll run the specific tests in `tests/test_ha.py` that were modified.
The modified tests are `test_start_as_readonly` (line 303 was modified, wait line 303 is in `test_start_as_readonly`? Let me check the line numbers in `read_file` again).
Wait, `read_file` for `tests/test_ha.py` around line 303:
```python
@patch.object(Cluster, 'is_unlocked', Mock(return_value=False))
def test_start_as_readonly(self):
self.p.is_leader = false
self.ha.has_lock = true
self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}
self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')
```
Yes, `test_start_as_readonly`.
And line 357 is `test_promote_because_have_lock`.
Let's run these tests.
Now I should verify that the tests still pass.
I'll run the specific tests in `tests/test_ha.py` that were modified.
The modified tests are `test_start_as_readonly` (line 303 was modified, wait line 303 is in `test_start_as_readonly`? Let me check the line numbers in `read_file` again).
Wait, `read_file` for `tests/test_ha.py` around line 303:
```python
@patch.object(Cluster, 'is_unlocked', Mock(return_value=False))
def test_start_as_readonly(self):
self.p.is_leader = false
self.ha.has_lock = true
self.p.controldata = lambda: {'Database cluster state': 'in production', 'Database system identifier': SYSID}
self.assertEqual(self.ha.run_cycle(), 'promoted self to leader because i had the session lock')
```
Yes, `test_start_as_readonly`.
And line 357 is `test_promote_because_have_lock`.
Let's run these tests.
<channel|><|tool_call>call:run_command{command:<|"|>pytest tests/test_ha.py -k "test_start_as_readonly or test_promote_because_have_lock" -q --tb=short --no-header<|"|>}<tool_call|><|tool_response>
Generated tokens 142 tokens · stopped: STOP
The tests passed. Now I should check if I missed anything. The problem statement mentioned `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`. As I found, the actual paths are `patroni/ha.py` and `tests/test_ha.py`. I should also quickly check if there are other tests that might be affected. I'll run all tests in `tests/test_ha.py` just to be sure.
The tests passed.
Now I should check if I missed anything.
The problem statement mentioned `patroni/patroni/ha.py` and `patroni/tests/test_ha.py`.
As I found, the actual paths are `patroni/ha.py` and `tests/test_ha.py`.
I should also quickly check if there are other tests that might be affected.
I'll run all tests in `tests/test_ha.py` just to be sure.
<channel|><|tool_call>call:run_command{command:<|"|>pytest tests/test_ha.py -q --tb=short --no-header<|"|>}<tool_call|><|tool_response>
Generated tokens 190 tokens · stopped: STOP
All tests in `tests/test_ha.py` passed. One more thing: the problem statement said "patroni/patroni/ha.py" and "patroni/tests/test_ha.py". Is it possible that the repository structure is different from what I see? `./patroni/ha.py` `./tests/test_ha.py` This matches the `grep` results. Wait, I should double check if there are other occurrences of `promoted self to leader because i had the session lock` in the whole repository. I already ran `grep -rn "promoted self to leader because i had the session lock" .` and it returned only those 3 lines. I'll do a final check of the diff.
All tests in `tests/test_ha.py` passed.
One more thing: the problem statement said "patroni/patroni/ha.py" and "patroni/tests/test_ha.py".
Is it possible that the repository structure is different from what I see?
`./patroni/ha.py`
`./tests/test_ha.py`
This matches the `grep` results.
Wait, I should double check if there are other occurrences of `promoted self to leader because i had the session lock` in the whole repository.
I already ran `grep -rn "promoted self to leader because i had the session lock" .` and it returned only those 3 lines.
I'll do a final check of the diff.
<channel|><|tool_call>call:run_command{command:<|"|>git status --short && git diff<|"|>}<tool_call|><|tool_response>
Generated tokens 62 tokens · stopped: STOP
The diff looks correct and minimal. I've addressed the specific typo mentioned in the problem statement in both production code and tests. Verified by running the relevant tests. No untracked files were created. No protected files were modified.
The diff looks correct and minimal.
I've addressed the specific typo mentioned in the problem statement in both production code and tests.
Verified by running the relevant tests.
No untracked files were created.
No protected files were modified.
<channel|><|tool_call>call:submit_patch{}<tool_call|><|tool_response>
Generated tokens 54 tokens · stopped: STOP
Wait, `files_changed: 1`? `git diff` showed 2 files changed. Let me check `git status --short` again.
Wait, `files_changed: 1`?
`git diff` showed 2 files changed.
Let me check `git status --short` again.
<channel|><|tool_call>call:run_command{command:<|"|>git status --short<|"|>}<tool_call|><|tool_response>
Patch, tests and logs
Final code change Included
diff --git a/patroni/ha.py b/patroni/ha.py
index 7d08dca..ee1c78e 100644
--- a/patroni/ha.py
+++ b/patroni/ha.py
@@ -1002,7 +1002,7 @@ class Ha(object):
else:
return self.enforce_master_role(
'no action. I am ({0}) the leader with the lock'.format(self.state_handler.name),
- 'promoted self to leader because i had the session lock'
+ 'promoted self to leader because I had the session lock'
)
else:
# Either there is no connection to DCS or someone else acquired the lock
Test output Included
============================= test session starts ==============================
collected 89 items
tests/test_ha.py ....................................................... [ 61%]
.................................. [100%]
==================================== PASSES ====================================
_______________________ TestHa.test__is_healthiest_node ________________________
------------------------------ Captured log call -------------------------------
WARNING patroni.ha:ha.py:635 Request failed to postgresql1: GET http://127.0.0.1:8009/patroni ('role')
WARNING patroni.ha:ha.py:676 Master (postgresql1) is still alive
____________________________ TestHa.test_abort_join ____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.ha:ha.py:1395 No initialize key in DCS and PostgreSQL is running as replica, aborting start
ERROR patroni.ha:ha.py:1396 Please first start Patroni on the node running as master
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:635 Request failed to postgresql1: GET http://127.0.0.1:8009/patroni ('role')
ERROR patroni.dcs.etcd:etcd.py:449 None
______________________ TestHa.test_acquire_lock_as_master ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_after_pause ____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________ TestHa.test_bootstrap_as_standby_leader ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
__________________ TestHa.test_bootstrap_from_another_member ___________________
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
_________________ TestHa.test_bootstrap_initialize_lock_failed _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 696, in initialize
return self.retry(self._client.write, self.initialize_path, sysid, prevExist=(not create_new))
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________________ TestHa.test_bootstrap_initialized_new_cluster _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________ TestHa.test_bootstrap_release_initialize_key_on_failure ____________
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 704, in cancel_initialization
return self.retry(self._client.delete, self.initialize_path)
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
_______ TestHa.test_bootstrap_release_initialize_key_on_watchdog_failure _______
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.ha:ha.py:1252 Cancelling bootstrap because watchdog activation failed
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 704, in cancel_initialization
return self.retry(self._client.delete, self.initialize_path)
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
_______________ TestHa.test_bootstrap_waiting_for_standby_leader _______________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_____________________ TestHa.test_bootstrap_without_leader _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:243 failed to bootstrap (without leader)
__________________________ TestHa.test_crash_recovery __________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:635 Request failed to leader: GET http://127.0.0.1:8008/patroni ('role')
WARNING patroni.postgresql.cancellable:cancellable.py:50 Killed None because it was still running
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 700, in _delete_leader
return self._client.delete(self.leader_path, prevValue=self._name)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
______________________ TestHa.test_delete_future_restarts ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
_______________ TestHa.test_demote_after_failing_to_obtain_lock ________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
__________________ TestHa.test_demote_because_not_having_lock __________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
__________________ TestHa.test_demote_because_not_healthiest ___________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________________ TestHa.test_demote_because_update_lock_failed _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.ha:ha.py:1009 failed to update leader lock
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.ha:ha.py:1009 failed to update leader lock
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________________ TestHa.test_demote_immediate _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 700, in _delete_leader
return self._client.delete(self.leader_path, prevValue=self._name)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________ TestHa.test_disable_sync_when_restarting ___________________
------------------------------ Captured log call -------------------------------
WARNING patroni.ha:ha.py:537 Could not get cluster state, skipping synchronous standby disable
WARNING patroni.ha:ha.py:541 Updating member state failed, skipping synchronous standby disable
_____________________ TestHa.test_empty_directory_in_pause _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
____________________ TestHa.test_evaluate_scheduled_restart ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
WARNING patroni.ha:ha.py:1048 Scheduled restart: Test
__________________ TestHa.test_failed_to_update_lock_in_pause __________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:1009 failed to update leader lock
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________ TestHa.test_failover_immediately_on_zero_master_start_timeout _________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:449 None
________________________ TestHa.test_fetch_node_status _________________________
------------------------------ Captured log call -------------------------------
WARNING patroni.ha:ha.py:635 Request failed to test: GET http://localhost:8011/patroni ()
______________________________ TestHa.test_follow ______________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql.slots:slots.py:231 Exception when changing replication slots
Traceback (most recent call last):
File "/patroni/patroni/postgresql/slots.py", line 212, in sync_replication_slots
self.load_replication_slots()
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
Exception
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql.slots:slots.py:231 Exception when changing replication slots
Traceback (most recent call last):
File "/patroni/patroni/postgresql/slots.py", line 212, in sync_replication_slots
self.load_replication_slots()
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
Exception
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_follow_copy ____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________________ TestHa.test_follow_in_pause __________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
__________ TestHa.test_follow_new_leader_after_failing_to_obtain_lock __________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
_____________ TestHa.test_follow_new_leader_because_not_healthiest _____________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
______________________ TestHa.test_follow_triggers_rewind ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql.rewind:rewind.py:348 Can not use leader for rewind: <Mock name='mock()' id='127320408543184'>
ERROR patroni.dcs.etcd:etcd.py:449 None
________________________ TestHa.test_is_healthiest_node ________________________
------------------------------ Captured log call -------------------------------
WARNING patroni.ha:ha.py:783 Watchdog device is not usable
___________________ TestHa.test_leader_with_empty_directory ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
_________________________ TestHa.test_leader_with_lock _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_long_promote ___________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________ TestHa.test_lost_leader_lock_during_promote __________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________ TestHa.test_manual_failover_from_leader ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:929 manual failover: leader name does not match: blabla != postgresql0
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:927 manual failover: I am already the leader, no need to failover
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:704 manual failover: members list is empty
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:929 manual failover: leader name does not match: blabla != postgresql0
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:887 Incorrect value of scheduled_at: 2026-11-14 03:42:26.635672
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:929 manual failover: leader name does not match: blabla != postgresql0
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:877 Found a stale failover value, cleaning up: 2026-11-14T03:32:56.635996+00:00
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:929 manual failover: leader name does not match: blabla != postgresql0
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
_______________ TestHa.test_manual_failover_from_leader_in_pause _______________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:909 Failover is possible only to a specific candidate in a paused state
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
_________ TestHa.test_manual_failover_from_leader_in_synchronous_mode __________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:913 Failover candidate=a does not match with sync_standbys=None
WARNING patroni.ha:ha.py:925 manual failover: no healthy members found, failover is not possible
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________________ TestHa.test_manual_failover_process_no_leader _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:635 Request failed to leader: GET http://127.0.0.1:8008/patroni ('role')
WARNING patroni.ha:ha.py:731 manual failover: member leader is not reachable
WARNING patroni.ha:ha.py:635 Request failed to leader: GET http://127.0.0.1:8008/patroni ('role')
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:731 manual failover: member other is not allowed to promote
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
____________ TestHa.test_manual_failover_process_no_leader_in_pause ____________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:717 manual failover: removing failover key because failover candidate is not running
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
__________________ TestHa.test_manual_failover_while_starting __________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 684, in _write_leader_optime
return self._client.set(self.leader_optime_path, last_lsn)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
_______________________ TestHa.test_master_stop_timeout ________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.config:config.py:199 Exception when setting dynamic_configuration
Traceback (most recent call last):
File "/patroni/patroni/config.py", line 193, in set_dynamic_configuration
self.__effective_configuration = self._build_effective_configuration(configuration,
File "/patroni/patroni/config.py", line 370, in _build_effective_configuration
config = self._safe_copy_dynamic_configuration(dynamic_configuration)
File "/patroni/patroni/config.py", line 239, in _safe_copy_dynamic_configuration
config[name] = int(value)
TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'
___________________ TestHa.test_no_etcd_connection_in_pause ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:1446 Error communicating with DCS
_________________ TestHa.test_no_etcd_connection_master_demote _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:1446 Error communicating with DCS
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
______________ TestHa.test_permanent_logical_slots_after_promote _______________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_post_recover ___________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 700, in _delete_leader
return self._client.delete(self.leader_path, prevValue=self._name)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
___________________ TestHa.test_postgres_unhealthy_in_pause ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________ TestHa.test_process_healthy_cluster_in_pause _________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 700, in _delete_leader
return self._client.delete(self.leader_path, prevValue=self._name)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
________ TestHa.test_process_healthy_standby_cluster_as_cascade_replica ________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
________ TestHa.test_process_healthy_standby_cluster_as_standby_leader _________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 696, in initialize
return self.retry(self._client.write, self.initialize_path, sysid, prevExist=(not create_new))
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_____________________ TestHa.test_process_sync_replication _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:494 Could not get cluster state from DCS during process_sync_replication()
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:478 No standbys available!
ERROR patroni.dcs.etcd:etcd.py:449 None
_______ TestHa.test_process_unhealthy_standby_cluster_as_cascade_replica _______
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql.rewind:rewind.py:348 Can not use remote_master:68f6e000-dfdd-11f1-a812-d51bba3ab286 for rewind: <Mock name='mock()' id='127320408543184'>
ERROR patroni.dcs.etcd:etcd.py:449 None
_______ TestHa.test_process_unhealthy_standby_cluster_as_standby_leader ________
------------------------------ Captured log call -------------------------------
WARNING patroni.ha:ha.py:635 Request failed to postgresql1: GET http://127.0.0.1:8009/patroni ('role')
WARNING patroni.ha:ha.py:635 Request failed to postgresql0: GET http://127.0.0.1:8008/patroni ('role')
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
____________________ TestHa.test_promote_because_have_lock _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_____________________ TestHa.test_promote_without_watchdog _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
____________________ TestHa.test_promoted_by_acquiring_lock ____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________ TestHa.test_promotion_cancelled_after_pre_promote_failed ___________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:587 Releasing the leader key voluntarily because the pre-promote script failed
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
______________________ TestHa.test_recover_former_master _______________________
------------------------------ Captured log call -------------------------------
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
______________________ TestHa.test_recover_replica_failed ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________ TestHa.test_recover_unhealthy_leader_in_standby_cluster ____________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 696, in initialize
return self.retry(self._client.write, self.initialize_path, sysid, prevExist=(not create_new))
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
____________ TestHa.test_recover_unhealthy_unlocked_standby_cluster ____________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 696, in initialize
return self.retry(self._client.write, self.initialize_path, sysid, prevExist=(not create_new))
File "/patroni/patroni/dcs/etcd.py", line 443, in retry
return retry(*args, **kwargs)
File "/patroni/patroni/utils.py", line 334, in __call__
return func(*args, **kwargs)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.dcs.etcd:etcd.py:449 None
____________________ TestHa.test_recover_with_reinitialize _____________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
ERROR patroni.ha:ha.py:243 failed to bootstrap from replica 'other'
ERROR patroni.dcs.etcd:etcd.py:449 None
_______________________ TestHa.test_recover_with_rewind ________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.postgresql:__init__.py:741 Postgresql is not running.
WARNING patroni.postgresql.rewind:rewind.py:348 Can not use leader for rewind: <Mock name='mock()' id='127320408543184'>
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_reinitialize ___________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
_____________________________ TestHa.test_restart ______________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
_______________________ TestHa.test_restart_in_progress ________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
______________________ TestHa.test_restore_cluster_config ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:807 Failed to read and parse ('data/test0/pg_xlog/00000002.history',)
Traceback (most recent call last):
File "/patroni/patroni/postgresql/__init__.py", line 799, in get_history
with open(history_path, 'r') as f:
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
Exception
ERROR patroni.dcs.etcd:etcd.py:449 None
____________________________ TestHa.test_run_cycle _____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:1465 Unexpected exception
Traceback (most recent call last):
File "/patroni/patroni/ha.py", line 1460, in run_cycle
info = self._run_cycle()
File "/patroni/patroni/ha.py", line 1455, in _run_cycle
self.touch_member()
File "/patroni/patroni/ha.py", line 230, in touch_member
return self.dcs.touch_member(data)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
patroni.exceptions.DCSError: 'foo'
_____________________ TestHa.test_schedule_future_restart ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________________________ TestHa.test_scheduled_restart _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
_____________________________ TestHa.test_shutdown _____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 684, in _write_leader_optime
return self._client.set(self.leader_optime_path, last_lsn)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________ TestHa.test_start_as_cascade_replica_in_standby_cluster ____________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
________________________ TestHa.test_start_as_readonly _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________________ TestHa.test_start_as_replica _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
_________________________ TestHa.test_starting_timeout _________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.postgresql:__init__.py:492 Cannot start PostgreSQL because one is already running.
ERROR patroni.dcs.etcd:etcd.py:449 None
__________________________ TestHa.test_sysid_no_match __________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
CRITICAL patroni.ha:ha.py:1387 system ID mismatch, node postgresql0 belongs to a different cluster: 12345678901 != 123
ERROR patroni.dcs.etcd:etcd.py:449 None
_____________________ TestHa.test_sysid_no_match_in_pause ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
WARNING patroni.ha:ha.py:1381 system ID has changed while in paused mode. Patroni will exit when resuming unless system ID is reset: 12345678901 != 123
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
WARNING patroni.ha:ha.py:1381 system ID has changed while in paused mode. Patroni will exit when resuming unless system ID is reset: 12345678901 != 123
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_touch_member ___________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
_______________________ TestHa.test_unhealthy_sync_mode ________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
______________________ TestHa.test_update_cluster_history ______________________
------------------------------ Captured log call -------------------------------
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 655, in touch_member
return self._client.set(self.member_path, data, None if permanent else self._ttl)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:447
Traceback (most recent call last):
File "/patroni/patroni/dcs/etcd.py", line 562, in wrapper
retval = func(self, *args, **kwargs) is not None
File "/patroni/patroni/dcs/etcd.py", line 688, in _write_status
return self._client.set(self.status_path, value)
File "/usr/local/lib/python3.10/site-packages/etcd/client.py", line 721, in set
return self.write(key, value, ttl=ttl)
File "/patroni/tests/test_etcd.py", line 33, in etcd_write
raise etcd.EtcdException
etcd.EtcdException: None
ERROR patroni.dcs.etcd:etcd.py:449 None
ERROR patroni.dcs.etcd:etcd.py:449 None
___________________________ TestHa.test_update_lock ____________________________
------------------------------ Captured log call -------------------------------
ERROR patroni.ha:ha.py:154 Exception when called state_handler.last_operation()
Traceback (most recent call last):
File "/patroni/patroni/ha.py", line 151, in update_lock
last_lsn = self.state_handler.last_operation()
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
patroni.exceptions.PostgresConnectionException: ''
ERROR patroni.ha:ha.py:158 Unexpected exception raised from update_leader, please report it as a BUG
Traceback (most recent call last):
File "/patroni/patroni/ha.py", line 156, in update_lock
ret = self.dcs.update_leader(last_lsn, slots)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1190, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1194, in _mock_call
return _mock_self._execute_mock_call(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/mock/mock.py", line 1251, in _execute_mock_call
raise effect
Exception
- generated xml file: /tmp/rebench-grade-0d6d15998e4e455eafec29a336761879.xml --
=========================== short test summary info ============================
PASSED tests/test_ha.py::TestHa::test__is_healthiest_node
PASSED tests/test_ha.py::TestHa::test_abort_join
PASSED tests/test_ha.py::TestHa::test_acquire_lock_as_master
PASSED tests/test_ha.py::TestHa::test_after_pause
PASSED tests/test_ha.py::TestHa::test_bootstrap_as_standby_leader
PASSED tests/test_ha.py::TestHa::test_bootstrap_from_another_member
PASSED tests/test_ha.py::TestHa::test_bootstrap_initialize_lock_failed
PASSED tests/test_ha.py::TestHa::test_bootstrap_initialized_new_cluster
PASSED tests/test_ha.py::TestHa::test_bootstrap_release_initialize_key_on_failure
PASSED tests/test_ha.py::TestHa::test_bootstrap_release_initialize_key_on_watchdog_failure
PASSED tests/test_ha.py::TestHa::test_bootstrap_waiting_for_leader
PASSED tests/test_ha.py::TestHa::test_bootstrap_waiting_for_standby_leader
PASSED tests/test_ha.py::TestHa::test_bootstrap_without_leader
PASSED tests/test_ha.py::TestHa::test_crash_recovery
PASSED tests/test_ha.py::TestHa::test_delete_future_restarts
PASSED tests/test_ha.py::TestHa::test_demote_after_failing_to_obtain_lock
PASSED tests/test_ha.py::TestHa::test_demote_because_not_having_lock
PASSED tests/test_ha.py::TestHa::test_demote_because_not_healthiest
PASSED tests/test_ha.py::TestHa::test_demote_because_update_lock_failed
PASSED tests/test_ha.py::TestHa::test_demote_immediate
PASSED tests/test_ha.py::TestHa::test_disable_sync_when_restarting
PASSED tests/test_ha.py::TestHa::test_effective_tags
PASSED tests/test_ha.py::TestHa::test_empty_directory_in_pause
PASSED tests/test_ha.py::TestHa::test_evaluate_scheduled_restart
PASSED tests/test_ha.py::TestHa::test_failed_to_update_lock_in_pause
PASSED tests/test_ha.py::TestHa::test_failover_immediately_on_zero_master_start_timeout
PASSED tests/test_ha.py::TestHa::test_fetch_node_status
PASSED tests/test_ha.py::TestHa::test_follow
PASSED tests/test_ha.py::TestHa::test_follow_copy
PASSED tests/test_ha.py::TestHa::test_follow_in_pause
PASSED tests/test_ha.py::TestHa::test_follow_new_leader_after_failing_to_obtain_lock
PASSED tests/test_ha.py::TestHa::test_follow_new_leader_because_not_healthiest
PASSED tests/test_ha.py::TestHa::test_follow_triggers_rewind
PASSED tests/test_ha.py::TestHa::test_is_healthiest_node
PASSED tests/test_ha.py::TestHa::test_is_leader
PASSED tests/test_ha.py::TestHa::test_leader_with_empty_directory
PASSED tests/test_ha.py::TestHa::test_leader_with_lock
PASSED tests/test_ha.py::TestHa::test_long_promote
PASSED tests/test_ha.py::TestHa::test_lost_leader_lock_during_promote
PASSED tests/test_ha.py::TestHa::test_manual_failover_from_leader
PASSED tests/test_ha.py::TestHa::test_manual_failover_from_leader_in_pause
PASSED tests/test_ha.py::TestHa::test_manual_failover_from_leader_in_synchronous_mode
PASSED tests/test_ha.py::TestHa::test_manual_failover_process_no_leader
PASSED tests/test_ha.py::TestHa::test_manual_failover_process_no_leader_in_pause
PASSED tests/test_ha.py::TestHa::test_manual_failover_while_starting
PASSED tests/test_ha.py::TestHa::test_master_stop_timeout
PASSED tests/test_ha.py::TestHa::test_no_etcd_connection_in_pause
PASSED tests/test_ha.py::TestHa::test_no_etcd_connection_master_demote
PASSED tests/test_ha.py::TestHa::test_permanent_logical_slots_after_promote
PASSED tests/test_ha.py::TestHa::test_post_recover
PASSED tests/test_ha.py::TestHa::test_postgres_unhealthy_in_pause
PASSED tests/test_ha.py::TestHa::test_process_healthy_cluster_in_pause
PASSED tests/test_ha.py::TestHa::test_process_healthy_standby_cluster_as_cascade_replica
PASSED tests/test_ha.py::TestHa::test_process_healthy_standby_cluster_as_standby_leader
PASSED tests/test_ha.py::TestHa::test_process_sync_replication
PASSED tests/test_ha.py::TestHa::test_process_unhealthy_standby_cluster_as_cascade_replica
PASSED tests/test_ha.py::TestHa::test_process_unhealthy_standby_cluster_as_standby_leader
PASSED tests/test_ha.py::TestHa::test_promote_because_have_lock
PASSED tests/test_ha.py::TestHa::test_promote_without_watchdog
PASSED tests/test_ha.py::TestHa::test_promoted_by_acquiring_lock
PASSED tests/test_ha.py::TestHa::test_promotion_cancelled_after_pre_promote_failed
PASSED tests/test_ha.py::TestHa::test_recover_former_master
PASSED tests/test_ha.py::TestHa::test_recover_replica_failed
PASSED tests/test_ha.py::TestHa::test_recover_unhealthy_leader_in_standby_cluster
PASSED tests/test_ha.py::TestHa::test_recover_unhealthy_unlocked_standby_cluster
PASSED tests/test_ha.py::TestHa::test_recover_with_reinitialize
PASSED tests/test_ha.py::TestHa::test_recover_with_rewind
PASSED tests/test_ha.py::TestHa::test_reinitialize
PASSED tests/test_ha.py::TestHa::test_restart
PASSED tests/test_ha.py::TestHa::test_restart_in_progress
PASSED tests/test_ha.py::TestHa::test_restart_matches
PASSED tests/test_ha.py::TestHa::test_restore_cluster_config
PASSED tests/test_ha.py::TestHa::test_run_cycle
PASSED tests/test_ha.py::TestHa::test_schedule_future_restart
PASSED tests/test_ha.py::TestHa::test_scheduled_restart
PASSED tests/test_ha.py::TestHa::test_shutdown
PASSED tests/test_ha.py::TestHa::test_start_as_cascade_replica_in_standby_cluster
PASSED tests/test_ha.py::TestHa::test_start_as_readonly
PASSED tests/test_ha.py::TestHa::test_start_as_replica
PASSED tests/test_ha.py::TestHa::test_starting_timeout
PASSED tests/test_ha.py::TestHa::test_sync_replication_become_master
PASSED tests/test_ha.py::TestHa::test_sysid_no_match
PASSED tests/test_ha.py::TestHa::test_sysid_no_match_in_pause
PASSED tests/test_ha.py::TestHa::test_touch_member
PASSED tests/test_ha.py::TestHa::test_unhealthy_sync_mode
PASSED tests/test_ha.py::TestHa::test_update_cluster_history
PASSED tests/test_ha.py::TestHa::test_update_lock
PASSED tests/test_ha.py::TestHa::test_wakup
PASSED tests/test_ha.py::TestHa::test_watch
============================== 89 passed in 0.67s ==============================
Test errors Included
Test report (JUnit) Included
<?xml version="1.0" encoding="utf-8"?><testsuites name="pytest tests"><testsuite name="pytest" errors="0" failures="0" skipped="0" tests="89" time="0.667" timestamp="2026-11-14T03:42:26.135799+00:00" hostname="4dba0750bf62"><testcase classname="tests.test_ha.TestHa" name="test__is_healthiest_node" time="0.011" /><testcase classname="tests.test_ha.TestHa" name="test_abort_join" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_acquire_lock_as_master" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_after_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_as_standby_leader" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_from_another_member" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_initialize_lock_failed" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_initialized_new_cluster" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_release_initialize_key_on_failure" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_release_initialize_key_on_watchdog_failure" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_waiting_for_leader" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_waiting_for_standby_leader" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_bootstrap_without_leader" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_crash_recovery" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_delete_future_restarts" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_demote_after_failing_to_obtain_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_demote_because_not_having_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_demote_because_not_healthiest" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_demote_because_update_lock_failed" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_demote_immediate" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_disable_sync_when_restarting" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_effective_tags" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_empty_directory_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_evaluate_scheduled_restart" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_failed_to_update_lock_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_failover_immediately_on_zero_master_start_timeout" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_fetch_node_status" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_follow" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_follow_copy" time="0.015" /><testcase classname="tests.test_ha.TestHa" name="test_follow_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_follow_new_leader_after_failing_to_obtain_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_follow_new_leader_because_not_healthiest" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_follow_triggers_rewind" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_is_healthiest_node" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_is_leader" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_leader_with_empty_directory" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_leader_with_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_long_promote" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_lost_leader_lock_during_promote" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_from_leader" time="0.011" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_from_leader_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_from_leader_in_synchronous_mode" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_process_no_leader" time="0.007" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_process_no_leader_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_manual_failover_while_starting" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_master_stop_timeout" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_no_etcd_connection_in_pause" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_no_etcd_connection_master_demote" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_permanent_logical_slots_after_promote" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_post_recover" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_postgres_unhealthy_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_process_healthy_cluster_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_process_healthy_standby_cluster_as_cascade_replica" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_process_healthy_standby_cluster_as_standby_leader" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_process_sync_replication" time="0.006" /><testcase classname="tests.test_ha.TestHa" name="test_process_unhealthy_standby_cluster_as_cascade_replica" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_process_unhealthy_standby_cluster_as_standby_leader" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_promote_because_have_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_promote_without_watchdog" time="0.004" /><testcase classname="tests.test_ha.TestHa" name="test_promoted_by_acquiring_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_promotion_cancelled_after_pre_promote_failed" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_former_master" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_replica_failed" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_unhealthy_leader_in_standby_cluster" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_unhealthy_unlocked_standby_cluster" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_with_reinitialize" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_recover_with_rewind" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_reinitialize" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_restart" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_restart_in_progress" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_restart_matches" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_restore_cluster_config" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_run_cycle" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_schedule_future_restart" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_scheduled_restart" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_shutdown" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_start_as_cascade_replica_in_standby_cluster" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_start_as_readonly" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_start_as_replica" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_starting_timeout" time="0.005" /><testcase classname="tests.test_ha.TestHa" name="test_sync_replication_become_master" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_sysid_no_match" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_sysid_no_match_in_pause" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_touch_member" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_unhealthy_sync_mode" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_update_cluster_history" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_update_lock" time="0.003" /><testcase classname="tests.test_ha.TestHa" name="test_wakup" time="0.002" /><testcase classname="tests.test_ha.TestHa" name="test_watch" time="0.002" /></testsuite></testsuites>
Agent log Included
[ 0.0s] 📋 System Prompt: You are a principal Python software engineer resolving a repository issue in `/workspace`.
[ 0.0s] 🎯 Task Prompt: You are evaluating a software engineering task for repository zalando/patroni.
[ 21.0s] 💭 (735 chars) "The user wants to fix a typo in a logging message.
Specifically, change `promoted self to leader because i had the sessi..."
[ 21.0s] 🔧 run_command grep -rn "promoted self to leader because i had the session lock" .
[ 21.1s] → ./patroni/ha.py:1005: 'promoted self to leader because i had the session lock'
[ 39.3s] 💭 (617 chars) "Okay, the search confirmed the occurrences in `patroni/ha.py` (line 1005) and
`tests/test_ha.py` (lines 303 and 357).
W..."
[ 39.3s] 📖 read_file (patroni/ha.py)
[ 39.3s] ✓ {'status': 'ok', 'filepath': 'patroni/ha.py', 'content': " 'promoted self to a
standby leader b…
[ 58.8s] 💭 (1106 chars) "Wait, I see two potentially similar lines in `patroni/ha.py`.
Line 1000: `'promoted self to a standby leader because i h..."
[ 58.8s] 📖 read_file (tests/test_ha.py)
[ 58.8s] ✓ {'status': 'ok', 'filepath': 'tests/test_ha.py', 'content': "
exit_mock.assert_called_once_with(1)\n\n @patch.…
[ 61.9s] 💭 (13 chars) "And line 357."
[ 61.9s] 📖 read_file (tests/test_ha.py)
[ 61.9s] ✓ {'status': 'ok', 'filepath': 'tests/test_ha.py', 'content': " self.p.is_leader = false\n
self.assertEqual(…
[ 75.8s] 💭 (868 chars) "Wait, I noticed another one in `tests/test_ha.py` line 352: `'following a different leader
because i am not the healthie..."
[ 75.8s] 🔧 run_command grep -rn " because i " .
[ 75.9s] → ./patroni/ha.py:347: msg = "starting as a standby leader because i had the session lock"
[ 131.1s] 💭 (2475 chars) "Wow, there are many.
`starting as a standby leader because i had the session lock`
`starting as readonly because i had t..."
[ 131.1s] ✏️ edit_file (patroni/ha.py)
[ 131.3s] ✓ {'status': 'ok', 'filepath': 'patroni/ha.py', 'occurrences': 1, 'strategy': 'exact', 'diff': "---
a/patroni/ha.py\n+++ b…
[ 134.7s] 💭 (24 chars) "Now let's fix the tests."
[ 134.7s] ✏️ edit_file (tests/test_ha.py)
[ 134.9s] ✓ {'status': 'ok', 'filepath': 'tests/test_ha.py', 'occurrences': 2, 'strategy': 'exact', 'diff': "---
a/tests/test_ha.py\…
[ 152.4s] 💭 (858 chars) "Now I should verify that the tests still pass.
I'll run the specific tests in `tests/test_ha.py` that were modified.
The..."
[ 152.4s] 🔧 run_command pytest tests/test_ha.py -k "test_start_as_readonly or test_promote_because_have_
[ 153.3s] → .. [100%]
[ 161.2s] 💭 (355 chars) "The tests passed.
Now I should check if I missed anything.
The problem statement mentioned `patroni/patroni/ha.py` and `..."
[ 161.2s] 🔧 run_command pytest tests/test_ha.py -q --tb=short --no-header
[ 161.8s] → ........................................................................ [ 80%]
[ 176.2s] 💭 (587 chars) "All tests in `tests/test_ha.py` passed.
One more thing: the problem statement said "patroni/patroni/ha.py" and "patroni..."
[ 176.2s] 🔧 run_command git status --short && git diff
[ 176.2s] → M patroni/ha.py
[ 184.0s] 💭 (245 chars) "The diff looks correct and minimal.
I've addressed the specific typo mentioned in the problem statement in both producti..."
[ 184.0s] 🤖 submit_patch
[ 184.1s] → submit_patch: {"status": "ok", "patch_size": 633, "files_changed": 1}
[ 187.6s] 💭 (101 chars) "Wait, `files_changed: 1`?
`git diff` showed 2 files changed.
Let me check `git status --short` again."
[ 187.6s] 🔧 run_command git status --short
[ 187.7s] → M patroni/ha.py
[ 298.8s] 💭 (5881 chars) "Hmm, `submit_patch` might have highlighted something else. Let me try to understand why
`files_changed: 1`.
Wait, I migh..."
[ 298.8s] ✅ Agent finished: Applying the fixes for the typo in `patroni/ha.py` and `tests/test_ha.py` ensures that
the logging message "promoted self to leader because I had the session lock" is correctly capitalized. The change...
Native result row
{
"agent_error": null,
"duration_seconds": 310.24,
"error": null,
"grade": {
"collected_tests": 89,
"competition_junit_ok": true,
"error": null,
"required_issues_count": 0,
"resolved": true,
"status_counts": {
"PASSED": 89
},
"strict_clean_patch": true,
"test_exit_code": 0
},
"instance_id": "zalando__patroni-1991",
"pass_idx": 0,
"patch_chars": 633,
"phase1_seconds": 308.6,
"repo": "zalando/patroni",
"request_log_path": "/kaggle-root/working/r31/rollouts_X/requests/zalando__patroni-1991__p0__r5.jsonl",
"resolved": true,
"rollout_idx": 5,
"run_key": "zalando__patroni-1991__p0__r5",
"strict_clean_patch": true,
"tool_calls": 11,
"total_llm_calls": 13,
"trace_path": "/kaggle-root/working/r31/rollouts_X/traces/trace_zalando__patroni-1991__p0__r5.json"
}