sensu delete a check from clients

Question

I created a test check and now I want it deleted. It doesn't seem to go away from the clients. I'm using uchima as a frontend and the check is no longer listed in

/checks

But if I view a client it still has the check.

The only way I found to delete the check is to delete the node and let it re-add itself. I have 300 clients and I'd rather not do that.

score 9 · Accepted Answer · edited Feb 09 '17 at 21:46

9

So recently encountered an issue where we deployed some sensu checks via ansible and they recreated existing checks with incorrect names. There would be nothing wrong with letting this go except it looks bad in the uchiwa interface. I followed steps above, but they must have been from an outdated version of sensu. Here are the modified steps I did to remove these checks.

Log in to Redis CLI redis-cli
Execute keys *server_name* to list all checks related to the server in question
type smembers result:server_name
srem result:server_name check_to_remove
del history:server_name:check_to_remove result:server_name:check_to_remove

This should remove the check completely from Redis, and then from sensu.

edited Feb 09 '17 at 21:46

Dan Bowling

309
1
3
12

answered Jun 05 '15 at 16:56

jonh

106
1
4

1

Minor correction: To list all the keys for a given server: `keys *server_name*` – jbbuckley Feb 17 '16 at 19:45
It looks like issue from sensu side, correct? – ipeacocks Mar 20 '16 at 00:02
1

I've also had to remove the events for the host if the check had a TTL. I looked at them with `hgetall events:server_name` then deleted the key with `hdel events:server_name name_of_check` – Dan Bowling Feb 09 '17 at 22:16

score 3 · Answer 2 · answered Jun 11 '16 at 10:27

3

Latest Uchiwa can do that itself http://docs.uchiwa.io/en/latest/features/deleting-check-results/

answered Jun 11 '16 at 10:27

ipeacocks

321
1
3
10

score 1 · Answer 3 · answered Feb 08 '15 at 22:41

1

In case anyone comes to this and wants to do the same WITHOUT flushing the entire Redis DB, you can do the following:

Log into redis (redis-cli from the command line)
Execute "keys *" to list all the keys
Locate both the history key and the execution key for the server / check combination that you want to delete

Example: Client: SomeServer, check: check_nginx

Commands to run:

del execution:SomeServer:check_nginx
del history:SomeServer:check_nginx

answered Feb 08 '15 at 22:41

Luckner Jr. Jean-Baptiste

111
1

this doesn't work. It's breaks the communication between redis and sensu-api. – hfranco Sep 18 '15 at 17:24

score 1 · Answer 4 · answered Apr 25 '17 at 09:07

Since sensu 0.21.0 there is a DELETE /results/:client/:check API which should help here. See docs here: https://sensuapp.org/docs/0.29/api/results-api.html#resultsclientcheck-delete

And this can also be done from uchiwa: https://docs.uchiwa.io/reference/clients/#request-to-delete-check-result-data

score 0 · Answer 5 · answered Nov 13 '14 at 04:10

0

So turns out you can't. You have to issue a flushall in redis

answered Nov 13 '14 at 04:10

Mike

21,910
7
55
79

That seems a little overly drastic. You can't just delete the relevant keys out of Redis? – womble Aug 11 '15 at 22:47

score 0 · Answer 6 · answered Nov 16 '14 at 19:52

0

A flushall is extreme overkill to resolve a single check.

To resolve a single check, you can issue the "resolve" api call, or click the resolve button.

On my servers I have a cron job that iterates over all the events with sensu-cli and resolves any that last checked > 1 week ago to prevent deleted checks from clogging the dashboard.

answered Nov 16 '14 at 19:52

SolarKennedy

31
2

its not to resolve a check.. if I added a check to a host and then deleted it.. it was still there and the way I wad told to handle it by a developer was to flush redis – Mike Nov 16 '14 at 21:13

score 0 · Answer 7 · answered Sep 26 '16 at 21:00

I want to add onto JonH's answer above:

You can find all the keys and checks via redis-cli:

keys *:*:name_of_check

and then go through and (e.g.)

del history:hostname:name_of_check

this will make searching for whichever nodes having the old check easier to sort through as the code above will print out only the servers and the specific check as opposed to keys * which will print out all keys.

Hope this helps!

sensu delete a check from clients

7 Answers7