xenofem/python-zulip-api
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity
286 commits 2 branches 0 tags 5.8 MiB
Commit graph

160 commits

Author SHA1 Message Date
Tim Abbott aba1ca871c check-mirroring: Try receiving zephyrs multiple times to avoid large queues. 
(imported from commit 08c08df46794cd89db19748c3d5adfa4097de4cb)
 2012-12-14 17:34:37 -05:00
Jessica McKellar 9d41da3625 feedback-bot: fix display_recipient typo that crashes the bot. 
(imported from commit 79ec561fe60074b0eec23780c6d6977a64c86a00)
 2012-12-11 10:22:52 -05:00
Tim Abbott 80075923ae check-mirroring: 'Detected server failure' notices go to stdout, not stderr. 
(imported from commit 9118b59130aaad274180c3c639ec897bc5634b9f)
 2012-12-11 08:55:17 -05:00
Tim Abbott 08f165e3ac zephyr_mirror: Add comment explaining why we drop the @ATHENA.MIT.EDU in zwrite -C. 
(imported from commit b591e2e0d6c607ef04e3c0005091078cfe23e3ff)
 2012-12-10 17:05:04 -05:00
Tim Abbott 8e0aabc730 zephyr_mirror: Improve debugging output on outgoing messages. 
Previously all that we logged was the sender, which turns out to be a
constant for humbug=>zephyr mirroring.

(imported from commit 527a3ac4b9b815a2b4d6b63c3ad92d9d5ad99a6e)
 2012-12-10 17:05:04 -05:00
Tim Abbott 69c1b8beca check_mirroring: Retry automatically on 'Detected server failure' errors. 
(imported from commit 2f834218bd492876749dd8953e522725935a7a1d)
 2012-12-10 17:05:04 -05:00
Tim Abbott d451cf3dc0 check-mirroring: Use zwrite -n to not send PINGs. 
(imported from commit e345f1b86c7f8850ac4eb4ae092cc83717e2cbe8)
 2012-12-10 17:05:04 -05:00
Tim Abbott bb80b86e25 zephyr_mirror: Fix handling of Humbug=>Zephyr personals. 
(imported from commit 149f8aaf9076583499392bcb09a0250b05c3dea6)
 2012-12-08 13:05:44 -05:00
Tim Abbott 94a553f0f1 zephyr_mirror: Use a variable for humbug_account_email. 
(imported from commit 90da406a5eab67d20b42243e96b8afb3e5b5f342)
 2012-12-08 13:00:22 -05:00
Tim Abbott 28d98729a5 zephyr_mirror: Fix detection of personals. 
(imported from commit 1fc9050bad36dc15e76f65bdb6532e3e7e601a40)
 2012-12-05 12:50:14 -05:00
Tim Abbott 37c837904f Don't send zwrite pings. 
(imported from commit 8dd7894eda6315ab52e61489e21ec1d201e86cc9)
 2012-12-05 12:04:18 -05:00
Zev Benjamin b945113867 [manual] Unify huddles and personals into private messages on the receive path 
feedback-bot and zephyr_mirror will need to be updated and restarted
when this is deployed to prod.

(imported from commit fe2b524424c174bcb1b717a851a5d3815fda3f69)
 2012-12-04 18:01:51 -05:00
Keegan McAllister 6d8519bc5d Add a Tddium post-build notification task for CUSTOMER1 
Resolves #502.

(imported from commit b88fa55ea6561b601a3d6519c84d56ba3098c3fe)
 2012-12-04 14:25:44 -05:00
Tim Abbott 1f99e40a7d zephyr-mirror-crontab: Fix truncation races. 
(imported from commit f50f34b3a739e67f2dffb442ac01e50eb7c9e4b8)
 2012-12-03 17:56:38 -05:00
Keegan McAllister b971ce4683 mirroring: Fix import by putting 'api' path first 
(imported from commit b35d962d6456f01b97deeeaa328faa03b65494f8)
 2012-12-03 17:50:29 -05:00
Keegan McAllister ac9e3d6483 zephyr_mirror_backend: Rename variable 'humbug' 
(imported from commit 2e278e4d2452f750cb874510a762fc9616e7dfb3)
 2012-12-03 17:49:27 -05:00
Keegan McAllister b1218ee829 gcal-bot: Rename variable 'humbug' 
It's weird to clobber the module, although it works.

(imported from commit 160d6e1c596ba6618c3da9c8cdc2f5cd3ca43dc6)
 2012-12-03 17:49:27 -05:00
Tim Abbott e4f2adaef6 Add zmirror's crontab to git. 
(imported from commit 37c96933a507c661c2ca252c78e5cd9e8a699ba2)
 2012-12-03 16:20:19 -05:00
Tim Abbott 24b8a7eccc zephyr_mirror: Fix case issue in subscriptions syncing. 
(imported from commit e87ddab3684f4acae940ee831caadbc346458a11)
 2012-12-03 16:20:19 -05:00
Keegan McAllister b7c1e02ede gcal-bot: Remove .humbug-api-key reading 
This behavior is part of api/humbug.py now.

(imported from commit 8a9722c8ad05391160cbb98387f34ef9924d81de)
 2012-12-03 15:54:54 -05:00
Keegan McAllister b9325a09fa Rename class HumbugAPI to Client 
(imported from commit 4270f31fc5febcd9c444d0d133a1dad3860618f0)
 2012-12-03 15:54:54 -05:00
Keegan McAllister f9f8a6e603 Rename api.common to humbug 
Fixes #482.

(imported from commit 1bd6a7fd993d8d5e225e0311c288dbce0c369a40)
 2012-12-03 15:54:54 -05:00
Tim Abbott 4bfd784423 Rewrite check-mirroring to be more robust and flexible. 
Features include:
* Not forking into two processes (shells out to zwrite to send
  instead).  This makes life easier since we're not doing concurrent
  programming.
* Eliminated a lot of hard-to-read or unnecessary debugging output.
* Adding explanatory test suggesting the likely problem for some
  common sets of received messages.
* Much less code duplication.
* Support for testing a sharded zephyr_mirror script (--sharded).
* Use of the logging module to print timestamps -- makes debugging
  some issues a lot.
* Only one sleep, and for only 10 seconds, between sending the
  outgoing messages and checking that they were received.
* Support for running two copies of this script at the same time, so that
  running it manually doesn't screw up Nagios.
* Passed running 100 tests run in a row.

(imported from commit a3ec02ac1d1a04972e469ca30fec1790c4fb53bc)
 2012-11-30 17:57:52 -05:00
Tim Abbott abb95fca04 zephyr_mirror: Move class name canonicalization earlier. 
We should be canonicalizing stream names to class names in
update_subscriptions_from_humbug, before we even decide which classes
to subscribe to; otherwise deduplication and tracking of which classes
we're already subscribed to won't work.

(imported from commit a751b6fca1022390a087516a0730ff77f13d7edf)
 2012-11-29 13:57:06 -05:00
Tim Abbott 8683613e76 zephyr_mirror: Add options to run class mirror without sharding for debugging. 
(imported from commit 4fcc403504d93e30aca6046cba9f1fe5342faac6)
 2012-11-29 13:57:06 -05:00
Tim Abbott 18bbd02074 zephyr_mirror: Don't leak zephyr_mirror processes on send_humbug failures. 
(imported from commit be005018672369683d9e3bdbf144f96f58af6b6c)
 2012-11-29 13:57:06 -05:00
Tim Abbott 074316105b zephyr_mirror: Replace bare excepts with 'except Exception'. 
(imported from commit 857212e0e5116471e418d37845550108c0a47d2b)
 2012-11-29 13:57:05 -05:00
Tim Abbott ab68503fcf zephyr_mirror: Compare zephyr subs from server after normalization. 
(imported from commit eea290698e83c7d26f23ab3bb0201914417f0e09)
 2012-11-28 22:26:10 -05:00
Tim Abbott c61567b67a zephyr_mirror: Add two more restricted access classes. 
(imported from commit 06ff0e19c1522ade018aea66f152fdfa55c18e1d)
 2012-11-28 22:26:10 -05:00
Tim Abbott 13ebd229c1 get_updates: Replace the "mirror" argument with checking "client". 
(imported from commit bd84c2c7a456de8ea7ec35eaf76b5bf8647ca61a)
 2012-11-28 17:41:38 -05:00
Tim Abbott 2b2398b712 zephyr_mirror: Pass an encoded stream to hashlib for sharding. 
(imported from commit cc57b3956198b66c9cfc84423434a71b8200d819)
 2012-11-28 15:44:35 -05:00
Tim Abbott de14210a4d zephyr_mirror: Validate zephyr subscriptions happened successfully. 
(imported from commit 494895b87eb9b555175c9890c5c2046cf4ce40ac)
 2012-11-28 15:44:35 -05:00
Tim Abbott 121c3cb9c8 zephyr_mirror: Fix display of personals on non-message classes. 
(imported from commit 42ff030d2d78c530428dcede406d46fc71521fef)
 2012-11-27 14:12:19 -05:00
Keegan McAllister 30f234d42d send-nagios-notification: Expand "\n" escape sequences that we get from Nagios 
(imported from commit 3e8efbfe8bbd5a2f13a8e02d9f44442b035113ba)
 2012-11-27 14:08:49 -05:00
Tim Abbott 305a8ce569 zephyr_mirror: Run the class mirror in 16 parallel shards. 
(imported from commit cb17ef999e94cc57d5b01114479728b04475c9c4)
 2012-11-27 12:09:57 -05:00
Tim Abbott bfec56661e zephyr_mirror: Add a --no-forward-from-humbug option. 
We'll use this to only have one of our shards forward from Humbug.

(imported from commit a6f3c2180b49c1fa826baf1ae9e7e3ba252a5bfa)
 2012-11-27 12:09:57 -05:00
Tim Abbott 975c8ef5b0 zephyr_mirror: Clean up unnecessary logic in process_notice. 
(imported from commit 28599789016fd1006c2de4d5ddc3cf1f10baa47f)
 2012-11-27 12:09:57 -05:00
Tim Abbott dbeb107aaf zephyr_mirror: Fix the check for whether a Zephyr is a personal. 
(imported from commit 609b6339fa82ecbd6435a386d24bf555e75a8120)
 2012-11-27 12:09:57 -05:00
Tim Abbott b081d2fa5a zephyr_mirror: Reorder process_notice to log fewer "Skipping" messages. 
Previously, we were sending "Skipping message we got from Humbug!"
for messages we wouldn't have forwarded anyway.

(imported from commit 36df85a61336ac00e3d7913d5a417d6b42764350)
 2012-11-27 12:09:57 -05:00
Tim Abbott f45a8bebf2 zephyr_mirror: Don't display/log some useless "Skipping" notices. 
In this case, if we're configured to not forward personals, there's no
point in logging a decision not to forward one.

(imported from commit 62c37591c6a70afb6235de626b0c6a3502cbcb27)
 2012-11-27 12:09:56 -05:00
Tim Abbott 333573f06b zephyr_mirror: Simplify optparse usage. 
(imported from commit d7cce4236dae6f369ea1cc4e12f89c2011718b7f)
 2012-11-27 12:09:56 -05:00
Tim Abbott ca34a2a02f check-mirroring: Fix some issues with startup process timing. 
It seems that check-mirroring was reporting a lot of spurious failures
due to it sometimes taking more than 3 seconds for the setup phase of
check-mirroring's receive path to run.  So fix this:

(1) Wait a bit more than 3 seconds for the receiver to subscribe to
messages

(2) Subscribe to Humbug messages before forking (we can't do this with
zephyr.init() because python-zephyr gets totally messed up if you use
it from multiple processes with a shared initialization)

(3) Get rid of the old time.sleep(0.x) values that were intended to
make messages arrive in order -- since we're now checking that
messages correctly arrived using set(), they aren't needed.

(4) Use a single request to subscribe to both zephyr classes we need
to subscribe to (saves 1 RTT).

(imported from commit d96aef05405ce43e9a4a549de189da9a2e393875)
 2012-11-26 17:10:15 -05:00
Tim Abbott ba33df97bb zephyr_mirror: Don't use @(@color(blue)) in zsigs. 
(imported from commit e4b594e3c22c25fa4f87baaad09227396bb92a0d)
 2012-11-26 16:19:09 -05:00
Tim Abbott 135f7f1b57 zephyr_mirror: Use default format to indicate what came from Humbug. 
(imported from commit 5c2fdccb08d605a37d6c87c37f023c06a0a9a760)
 2012-11-26 16:18:05 -05:00
Tim Abbott 111a9bc0e6 zephyr_mirror: Refactor zwrite_args handling a bit. 
(imported from commit 4923c90dc546022d48f226c2a204e9d09717b563)
 2012-11-26 14:58:34 -05:00
Keegan McAllister 84d73db4f3 Send Nagios alerts to Humbug 
Fixes #385.

(imported from commit 7dac013debd6ccff031fc4da0dd7185e198b4498)
 2012-11-26 14:42:55 -05:00
Tim Abbott fcf24e30f5 check-mirroring: Add subscriptions inside IOError check. 
(imported from commit d3b00ce9d91a0bcffcef58436a4b90770155fce9)
 2012-11-26 12:25:39 -05:00
Tim Abbott 9d6ce4ee0b api: Add copyright and MIT license notices to distributed tools. 
(imported from commit 9f93050f988549dc363f5a7c798c8a9fa1c01d29)
 2012-11-26 12:25:38 -05:00
Tim Abbott 27d597d686 zephyr_mirror: Don't break long words/urls when mirroring. 
(imported from commit df2b6a6969fc54016eeee4996df317e2843844c8)
 2012-11-21 15:55:18 -05:00
Tim Abbott 27b02176bc zephyr_mirror: Fix running --sync-subscriptions repeatedly. 
(imported from commit 15bead790590c91cd4a1d794799f94341d31c181)
 2012-11-20 17:17:40 -05:00