xenofem/python-zulip-api
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity
292 commits 2 branches 0 tags 5.8 MiB
Commit graph

166 commits

Author SHA1 Message Date
Tim Abbott a22f94633b zephyr_mirror: Fix insecure temporary file for log. 
This is probably a lot more annoying to use, in that e.g. there are
separate log files for the two directions of the mirror, but we
haven't used these logs for much, so whatever.

(imported from commit d3bc407d90099214d242526c01cd3d3cd9d9d9bd)
 2012-12-20 14:30:20 -05:00
Tim Abbott e609692e33 zephyr_mirror: Add a few more restricted-access classes. 
(imported from commit 6690e5dcd6a313ac4e4ef2351e300306ca7fb3c5)
 2012-12-19 08:49:14 -05:00
Tim Abbott 6aa8257102 check-mirroring: Fix spurious double-sent messages due to ACK failures. 
(imported from commit 9010bd08779ce3bf9ce1dca761910be504b6463a)
 2012-12-18 13:13:43 -05:00
Waseem Daher a3fba04fdd Don't consider hyphens to be an acceptable place to wordwrap. 
Otherwise, URLs like this one from catherio:
  http://www.sadiemagazine.com/issue-no-11/arts-letters/comic/i-think-i-am-in-friend-love-with-you
don't go to zephyr as one line, which makes them really
annoying to click on barnowl, etc.

(imported from commit d14f0af7d24a6cb8bc7cb0582f60116308f59923)
 2012-12-18 11:03:18 -05:00
Tim Abbott 10f8eac0e5 check-mirroring: Fix hardcoded logging path. 
(imported from commit 93b0d27285f79ecd7286cc07bc7727f754bc8012)
 2012-12-14 17:34:37 -05:00
Tim Abbott 706e37faf9 check_mirroring: Fix sharded stream names and add test for them. 
The original ones were incorrectly computed with a trailing newline
character.

(imported from commit 8f4e4e436104aec33e858fa7a65583a1dbc2eaff)
 2012-12-14 17:34:37 -05:00
Tim Abbott aba1ca871c check-mirroring: Try receiving zephyrs multiple times to avoid large queues. 
(imported from commit 08c08df46794cd89db19748c3d5adfa4097de4cb)
 2012-12-14 17:34:37 -05:00
Jessica McKellar 9d41da3625 feedback-bot: fix display_recipient typo that crashes the bot. 
(imported from commit 79ec561fe60074b0eec23780c6d6977a64c86a00)
 2012-12-11 10:22:52 -05:00
Tim Abbott 80075923ae check-mirroring: 'Detected server failure' notices go to stdout, not stderr. 
(imported from commit 9118b59130aaad274180c3c639ec897bc5634b9f)
 2012-12-11 08:55:17 -05:00
Tim Abbott 08f165e3ac zephyr_mirror: Add comment explaining why we drop the @ATHENA.MIT.EDU in zwrite -C. 
(imported from commit b591e2e0d6c607ef04e3c0005091078cfe23e3ff)
 2012-12-10 17:05:04 -05:00
Tim Abbott 8e0aabc730 zephyr_mirror: Improve debugging output on outgoing messages. 
Previously all that we logged was the sender, which turns out to be a
constant for humbug=>zephyr mirroring.

(imported from commit 527a3ac4b9b815a2b4d6b63c3ad92d9d5ad99a6e)
 2012-12-10 17:05:04 -05:00
Tim Abbott 69c1b8beca check_mirroring: Retry automatically on 'Detected server failure' errors. 
(imported from commit 2f834218bd492876749dd8953e522725935a7a1d)
 2012-12-10 17:05:04 -05:00
Tim Abbott d451cf3dc0 check-mirroring: Use zwrite -n to not send PINGs. 
(imported from commit e345f1b86c7f8850ac4eb4ae092cc83717e2cbe8)
 2012-12-10 17:05:04 -05:00
Tim Abbott bb80b86e25 zephyr_mirror: Fix handling of Humbug=>Zephyr personals. 
(imported from commit 149f8aaf9076583499392bcb09a0250b05c3dea6)
 2012-12-08 13:05:44 -05:00
Tim Abbott 94a553f0f1 zephyr_mirror: Use a variable for humbug_account_email. 
(imported from commit 90da406a5eab67d20b42243e96b8afb3e5b5f342)
 2012-12-08 13:00:22 -05:00
Tim Abbott 28d98729a5 zephyr_mirror: Fix detection of personals. 
(imported from commit 1fc9050bad36dc15e76f65bdb6532e3e7e601a40)
 2012-12-05 12:50:14 -05:00
Tim Abbott 37c837904f Don't send zwrite pings. 
(imported from commit 8dd7894eda6315ab52e61489e21ec1d201e86cc9)
 2012-12-05 12:04:18 -05:00
Zev Benjamin b945113867 [manual] Unify huddles and personals into private messages on the receive path 
feedback-bot and zephyr_mirror will need to be updated and restarted
when this is deployed to prod.

(imported from commit fe2b524424c174bcb1b717a851a5d3815fda3f69)
 2012-12-04 18:01:51 -05:00
Keegan McAllister 6d8519bc5d Add a Tddium post-build notification task for CUSTOMER1 
Resolves #502.

(imported from commit b88fa55ea6561b601a3d6519c84d56ba3098c3fe)
 2012-12-04 14:25:44 -05:00
Tim Abbott 1f99e40a7d zephyr-mirror-crontab: Fix truncation races. 
(imported from commit f50f34b3a739e67f2dffb442ac01e50eb7c9e4b8)
 2012-12-03 17:56:38 -05:00
Keegan McAllister b971ce4683 mirroring: Fix import by putting 'api' path first 
(imported from commit b35d962d6456f01b97deeeaa328faa03b65494f8)
 2012-12-03 17:50:29 -05:00
Keegan McAllister ac9e3d6483 zephyr_mirror_backend: Rename variable 'humbug' 
(imported from commit 2e278e4d2452f750cb874510a762fc9616e7dfb3)
 2012-12-03 17:49:27 -05:00
Keegan McAllister b1218ee829 gcal-bot: Rename variable 'humbug' 
It's weird to clobber the module, although it works.

(imported from commit 160d6e1c596ba6618c3da9c8cdc2f5cd3ca43dc6)
 2012-12-03 17:49:27 -05:00
Tim Abbott e4f2adaef6 Add zmirror's crontab to git. 
(imported from commit 37c96933a507c661c2ca252c78e5cd9e8a699ba2)
 2012-12-03 16:20:19 -05:00
Tim Abbott 24b8a7eccc zephyr_mirror: Fix case issue in subscriptions syncing. 
(imported from commit e87ddab3684f4acae940ee831caadbc346458a11)
 2012-12-03 16:20:19 -05:00
Keegan McAllister b7c1e02ede gcal-bot: Remove .humbug-api-key reading 
This behavior is part of api/humbug.py now.

(imported from commit 8a9722c8ad05391160cbb98387f34ef9924d81de)
 2012-12-03 15:54:54 -05:00
Keegan McAllister b9325a09fa Rename class HumbugAPI to Client 
(imported from commit 4270f31fc5febcd9c444d0d133a1dad3860618f0)
 2012-12-03 15:54:54 -05:00
Keegan McAllister f9f8a6e603 Rename api.common to humbug 
Fixes #482.

(imported from commit 1bd6a7fd993d8d5e225e0311c288dbce0c369a40)
 2012-12-03 15:54:54 -05:00
Tim Abbott 4bfd784423 Rewrite check-mirroring to be more robust and flexible. 
Features include:
* Not forking into two processes (shells out to zwrite to send
  instead).  This makes life easier since we're not doing concurrent
  programming.
* Eliminated a lot of hard-to-read or unnecessary debugging output.
* Adding explanatory test suggesting the likely problem for some
  common sets of received messages.
* Much less code duplication.
* Support for testing a sharded zephyr_mirror script (--sharded).
* Use of the logging module to print timestamps -- makes debugging
  some issues a lot.
* Only one sleep, and for only 10 seconds, between sending the
  outgoing messages and checking that they were received.
* Support for running two copies of this script at the same time, so that
  running it manually doesn't screw up Nagios.
* Passed running 100 tests run in a row.

(imported from commit a3ec02ac1d1a04972e469ca30fec1790c4fb53bc)
 2012-11-30 17:57:52 -05:00
Tim Abbott abb95fca04 zephyr_mirror: Move class name canonicalization earlier. 
We should be canonicalizing stream names to class names in
update_subscriptions_from_humbug, before we even decide which classes
to subscribe to; otherwise deduplication and tracking of which classes
we're already subscribed to won't work.

(imported from commit a751b6fca1022390a087516a0730ff77f13d7edf)
 2012-11-29 13:57:06 -05:00
Tim Abbott 8683613e76 zephyr_mirror: Add options to run class mirror without sharding for debugging. 
(imported from commit 4fcc403504d93e30aca6046cba9f1fe5342faac6)
 2012-11-29 13:57:06 -05:00
Tim Abbott 18bbd02074 zephyr_mirror: Don't leak zephyr_mirror processes on send_humbug failures. 
(imported from commit be005018672369683d9e3bdbf144f96f58af6b6c)
 2012-11-29 13:57:06 -05:00
Tim Abbott 074316105b zephyr_mirror: Replace bare excepts with 'except Exception'. 
(imported from commit 857212e0e5116471e418d37845550108c0a47d2b)
 2012-11-29 13:57:05 -05:00
Tim Abbott ab68503fcf zephyr_mirror: Compare zephyr subs from server after normalization. 
(imported from commit eea290698e83c7d26f23ab3bb0201914417f0e09)
 2012-11-28 22:26:10 -05:00
Tim Abbott c61567b67a zephyr_mirror: Add two more restricted access classes. 
(imported from commit 06ff0e19c1522ade018aea66f152fdfa55c18e1d)
 2012-11-28 22:26:10 -05:00
Tim Abbott 13ebd229c1 get_updates: Replace the "mirror" argument with checking "client". 
(imported from commit bd84c2c7a456de8ea7ec35eaf76b5bf8647ca61a)
 2012-11-28 17:41:38 -05:00
Tim Abbott 2b2398b712 zephyr_mirror: Pass an encoded stream to hashlib for sharding. 
(imported from commit cc57b3956198b66c9cfc84423434a71b8200d819)
 2012-11-28 15:44:35 -05:00
Tim Abbott de14210a4d zephyr_mirror: Validate zephyr subscriptions happened successfully. 
(imported from commit 494895b87eb9b555175c9890c5c2046cf4ce40ac)
 2012-11-28 15:44:35 -05:00
Tim Abbott 121c3cb9c8 zephyr_mirror: Fix display of personals on non-message classes. 
(imported from commit 42ff030d2d78c530428dcede406d46fc71521fef)
 2012-11-27 14:12:19 -05:00
Keegan McAllister 30f234d42d send-nagios-notification: Expand "\n" escape sequences that we get from Nagios 
(imported from commit 3e8efbfe8bbd5a2f13a8e02d9f44442b035113ba)
 2012-11-27 14:08:49 -05:00
Tim Abbott 305a8ce569 zephyr_mirror: Run the class mirror in 16 parallel shards. 
(imported from commit cb17ef999e94cc57d5b01114479728b04475c9c4)
 2012-11-27 12:09:57 -05:00
Tim Abbott bfec56661e zephyr_mirror: Add a --no-forward-from-humbug option. 
We'll use this to only have one of our shards forward from Humbug.

(imported from commit a6f3c2180b49c1fa826baf1ae9e7e3ba252a5bfa)
 2012-11-27 12:09:57 -05:00
Tim Abbott 975c8ef5b0 zephyr_mirror: Clean up unnecessary logic in process_notice. 
(imported from commit 28599789016fd1006c2de4d5ddc3cf1f10baa47f)
 2012-11-27 12:09:57 -05:00
Tim Abbott dbeb107aaf zephyr_mirror: Fix the check for whether a Zephyr is a personal. 
(imported from commit 609b6339fa82ecbd6435a386d24bf555e75a8120)
 2012-11-27 12:09:57 -05:00
Tim Abbott b081d2fa5a zephyr_mirror: Reorder process_notice to log fewer "Skipping" messages. 
Previously, we were sending "Skipping message we got from Humbug!"
for messages we wouldn't have forwarded anyway.

(imported from commit 36df85a61336ac00e3d7913d5a417d6b42764350)
 2012-11-27 12:09:57 -05:00
Tim Abbott f45a8bebf2 zephyr_mirror: Don't display/log some useless "Skipping" notices. 
In this case, if we're configured to not forward personals, there's no
point in logging a decision not to forward one.

(imported from commit 62c37591c6a70afb6235de626b0c6a3502cbcb27)
 2012-11-27 12:09:56 -05:00
Tim Abbott 333573f06b zephyr_mirror: Simplify optparse usage. 
(imported from commit d7cce4236dae6f369ea1cc4e12f89c2011718b7f)
 2012-11-27 12:09:56 -05:00
Tim Abbott ca34a2a02f check-mirroring: Fix some issues with startup process timing. 
It seems that check-mirroring was reporting a lot of spurious failures
due to it sometimes taking more than 3 seconds for the setup phase of
check-mirroring's receive path to run.  So fix this:

(1) Wait a bit more than 3 seconds for the receiver to subscribe to
messages

(2) Subscribe to Humbug messages before forking (we can't do this with
zephyr.init() because python-zephyr gets totally messed up if you use
it from multiple processes with a shared initialization)

(3) Get rid of the old time.sleep(0.x) values that were intended to
make messages arrive in order -- since we're now checking that
messages correctly arrived using set(), they aren't needed.

(4) Use a single request to subscribe to both zephyr classes we need
to subscribe to (saves 1 RTT).

(imported from commit d96aef05405ce43e9a4a549de189da9a2e393875)
 2012-11-26 17:10:15 -05:00
Tim Abbott ba33df97bb zephyr_mirror: Don't use @(@color(blue)) in zsigs. 
(imported from commit e4b594e3c22c25fa4f87baaad09227396bb92a0d)
 2012-11-26 16:19:09 -05:00
Tim Abbott 135f7f1b57 zephyr_mirror: Use default format to indicate what came from Humbug. 
(imported from commit 5c2fdccb08d605a37d6c87c37f023c06a0a9a760)
 2012-11-26 16:18:05 -05:00