Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.969663735s FAIL (2025-08-23 00:09:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 5.969683693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X........................................X........] duration: 2.819375909s FAIL (2025-08-23 00:09:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 2.81940224s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X...........................X.....X.......X] duration: 866.334552ms FAIL (2025-08-23 00:09:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 00:09:06.657259582 (342h43m1.088339713s) [upload=356509]: Starting upload Aug 23 00:09:06.657324687 (342h43m1.088404808s) [upload=356509]: Done starting upload Aug 23 00:09:06.657512626 (342h43m1.088592757s) [upload=356509]: Uploading segments... Aug 23 00:09:06.657553414 (342h43m1.088633545s) [upload=356509]: Got next segment. Inline: false Aug 23 00:09:06.657583892 (342h43m1.088664023s) [upload=356509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:09:06.657589332 (342h43m1.088669464s) [upload=356509]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:09:06.870553005 (342h43m1.301633136s) [upload=356509]: Next segment err: metaclient: Too Many Requests Aug 23 00:09:06.870574114 (342h43m1.301654245s) [upload=356509]: Done uploading segments... Aug 23 00:09:06.870588162 (342h43m1.301668293s) [upload=356509]: Upload finished. err: metaclient: Too Many Requests Duration: 866.358567ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.957426939s FAIL (2025-08-23 00:08:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 5.957453749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.158755334s FAIL (2025-08-23 00:08:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.158784191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.................X...........................X.....X.......] duration: 6.179541482s FAIL (2025-08-23 00:08:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 6.179568665s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X........................................X.......] duration: 2.053012763s FAIL (2025-08-23 00:08:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 2.053038041s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.938310182s FAIL (2025-08-23 00:07:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 5.938334178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.................X...........................X.....X......] duration: 6.014650672s FAIL (2025-08-23 00:07:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 6.014676311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.371549716s FAIL (2025-08-23 00:07:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.371582159s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X........................................X......] duration: 2.106123371s FAIL (2025-08-23 00:07:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 2.10614351s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.X.................X...........................X.....X.....] duration: 5.936400129s FAIL (2025-08-23 00:07:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 5.936425988s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.10167287s FAIL (2025-08-23 00:07:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.101699812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.X.................X...........................X.....X....] duration: 5.802824703s FAIL (2025-08-23 00:06:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 5.802855772s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X........................................X.....] duration: 2.089683135s FAIL (2025-08-23 00:06:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 2.089708994s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.165279027s FAIL (2025-08-23 00:06:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.165311979s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X........................................X....] duration: 1.873994182s FAIL (2025-08-23 00:06:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 1.874016275s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.X.................X...........................X.....X...] duration: 5.907607391s FAIL (2025-08-23 00:06:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 5.907635665s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X..X.X.................X...........................X.....X..] duration: 6.553924939s FAIL (2025-08-23 00:05:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 6.553953013s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.175333639s FAIL (2025-08-23 00:05:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.175377333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X........................................X...] duration: 1.861259616s FAIL (2025-08-23 00:05:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 1.861285535s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X..X.X.................X...........................X.....X.] duration: 6.291385844s FAIL (2025-08-23 00:05:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 6.291409649s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X........................................X..] duration: 3.041891336s FAIL (2025-08-23 00:05:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 3.041918747s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.197355417s FAIL (2025-08-23 00:05:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.19738287s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X..X.X.................X...........................X.....X] duration: 6.4502005s FAIL (2025-08-23 00:04:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ae4aee1686d1c03f9c26ebb6d0362b5a3ac9908857e28385a54449bef1e9179d != before 2429bad00f2f616c265597ef026f6436a944abd7be03b634f3a49051d38d737a ======LOGS====== Aug 23 00:04:47.802693389 (342h38m42.23377355s) [upload=356429]: Starting upload Aug 23 00:04:47.802789453 (342h38m42.233869584s) [upload=356429]: Done starting upload Aug 23 00:04:47.802855960 (342h38m42.233936131s) [upload=356429]: Uploading segments... Aug 23 00:04:47.803235577 (342h38m42.234315748s) [upload=356429]: Got next segment. Inline: false Aug 23 00:04:47.803288849 (342h38m42.23436901s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:47.803297104 (342h38m42.234377275s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 23 00:04:48.257439544 (342h38m42.688519665s) [seg_pos={0 0}, upload=356429]: Begin upload segment... Aug 23 00:04:48.257477697 (342h38m42.688557828s) [seg_pos={0 0}, upload=356429]: Done begin upload segment. Aug 23 00:04:48.257496684 (342h38m42.688576815s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257509960 (342h38m42.688590101s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257875789 (342h38m42.68895592s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.257930464 (342h38m42.689010585s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258156246 (342h38m42.689236377s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258419961 (342h38m42.689500082s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258469476 (342h38m42.689549607s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258701319 (342h38m42.68978146s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.258964923 (342h38m42.690045055s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259015239 (342h38m42.69009537s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259195414 (342h38m42.690275545s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259421707 (342h38m42.690501838s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259454379 (342h38m42.69053451s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259645966 (342h38m42.690726097s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.259879713 (342h38m42.690959845s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260283386 (342h38m42.691363517s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.260635729 (342h38m42.691715871s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:48.262175105 (342h38m42.693255266s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Uploading piece... Aug 23 00:04:49.786471589 (342h38m44.21755172s) [upload=356429]: Next returned nil segment Aug 23 00:04:49.786839253 (342h38m44.217919384s) [upload=356429]: Waiting for error group managing segments... Aug 23 00:04:50.206410906 (342h38m44.637491037s) [noise=true , address=104.36.82.12:4155 , piece_id=OE3Z6LLN7NHQTCXERZU4NVXEHKM3VYWCTHVFHB3N2ZKYCAULASNQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.249454815 (342h38m44.680534936s) [noise=true , address=104.36.82.14:4231 , piece_id=ENW3YNKDKTJO6VGMPHLC4PILQPPK2HBJ6M55ABDGKMCUTIVLZKKQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.252164950 (342h38m44.683245081s) [noise=true , address=45.91.116.4:4949 , piece_id=S5U765244EQPFKZ66YNIWRG6ZM3MDSSETZ7LUOQAZW3MFZZ4LUZQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.274157240 (342h38m44.705237401s) [noise=true , address=104.36.82.6:4883 , piece_id=TEZR2BII4KOBAX7WZYLCAX6PCRLYBBZU5OKUGOOSPFX6FQL5XBLA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.287867433 (342h38m44.718947564s) [noise=true , address=77.90.31.11:4580 , piece_id=PKUGXIMIQ4FDICZN3OYPAXE46YY3RDPXSRA5BFORCQORI6F25RHQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.317489071 (342h38m44.748569202s) [noise=true , address=45.91.116.11:4146 , piece_id=6FQ5764LXBXMAHKMLWP5BFMQVRUNKTFB6PIPCKCKK4D4RE6K3S5Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.322600350 (342h38m44.753680481s) [noise=true , address=104.36.82.55:4195 , piece_id=T7EUPKGXOER6UCFZRT32WGGJ2V3YOTIQFZTWQZ7K5Y2FKEODSSHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.379264070 (342h38m44.810344201s) [noise=true , address=104.36.82.36:4638 , piece_id=W67PE775GYGX2YPFXDDHEFUP3MERNTS7KFGW3RCAOCFT6WZUH5VA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.383978501 (342h38m44.815058632s) [noise=true , address=77.90.31.18:4837 , piece_id=U6NL5IZ2S25XTY2UU6RA5D7K5RHKKDGFHAVJSJYCDULUS5PJVYDA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.388271775 (342h38m44.819351916s) [noise=true , address=104.36.82.50:4039 , piece_id=2PWR7IN5ZRTLOQH5Q7U3I6COBIRCWUYB4NHZKOQKNX5GX3OAUS4Q, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.415368752 (342h38m44.846448883s) [noise=true , address=45.91.116.5:4325 , piece_id=XDJYTGJRAH56MCRY4YS4QSJGPRUXRXZNRKQDB2F5MOJBC5T2PVAA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.435550878 (342h38m44.86663101s) [noise=true , address=104.36.82.18:4380 , piece_id=KS2EWPPC44772DU5NI2ZMWYQVBYORF4EABVGPOE3BVKOFK4Z6F3A, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.714400905 (342h38m45.145481036s) [noise=true , address=77.90.31.10:4536 , piece_id=ZPYWJYK2OXIDG5MT7N5DFOP7QZC57WXWDZPZMSBP4OBBHSKCT3NQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741506157 (342h38m45.172586279s) [noise=true , address=104.36.82.54:4165 , piece_id=EJGH7JDEMGB22UK2CMOML5MWVE66YLYBWNWRTAQFPR5Q7RS5RCVQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: <nil> Aug 23 00:04:50.741530113 (342h38m45.172610245s) [seg_pos={0 0}, upload=356429]: Segment reached optimal threshold of 14 pieces. Aug 23 00:04:50.741664441 (342h38m45.172744572s) [noise=true , address=104.36.82.19:4416 , piece_id=XKVHYKBBWZSVPG3KXTACXYIAV4YSQIYSLZDQBQBSWCI5LL62L4NA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rwbh1TjuvXvNEcTKsS49FMV3YKJUUzea9K8zFdDXns2ZyMcvg): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741725056 (342h38m45.172805187s) [noise=true , address=104.36.82.23:4472 , piece_id=YHUAWEUAX3DGHNOVDFYZ4DNI6OBVHKO2ALSBL7Y33XI4UPHJD5TQ, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741888720 (342h38m45.172968861s) [noise=true , address=77.90.31.21:4900 , piece_id=2T2ICMLL5VFTDHW4KPYD57KKHB4XGAHN7QCOWSWLEZVFJHZXPQIA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh): protocol: expected piece hash; context canceled; EOF Aug 23 00:04:50.741968402 (342h38m45.173048533s) [noise=true , address=104.36.82.5:4863 , piece_id=YVSBSBQ5COMATYLSMZ45NMGQYXGKKVK6ARWOSYYSDR4WBWVE4JHA, seg_pos={0 0}, upload=356429]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55646->104.36.82.5:4863: use of closed network connection Aug 23 00:04:50.741989403 (342h38m45.173069524s) [seg_pos={0 0}, upload=356429]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 23 00:04:50.742047534 (342h38m45.173127665s) [upload=356429]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 23 00:04:50.742052603 (342h38m45.173132784s) [upload=356429]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:51.121779266 (342h38m45.552859407s) [upload=356429]: Done uploading segments... Aug 23 00:04:51.121828931 (342h38m45.552909082s) [upload=356429]: Upload finished. err: <nil> Duration: 6.450225667s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.234785455s FAIL (2025-08-23 00:04:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.234812987s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X........................................X.] duration: 1.89910623s FAIL (2025-08-23 00:04:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 1.899140526s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X........................................X] duration: 1.614580754s FAIL (2025-08-23 00:04:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:04:02.118946134 (342h37m56.550026286s) [upload=356417]: Starting upload Aug 23 00:04:02.119026448 (342h37m56.550106579s) [upload=356417]: Done starting upload Aug 23 00:04:02.119109808 (342h37m56.550189949s) [upload=356417]: Uploading segments... Aug 23 00:04:02.119244325 (342h37m56.550324476s) [upload=356417]: Got next segment. Inline: true Aug 23 00:04:02.119251398 (342h37m56.550331529s) [upload=356417]: Waiting for error group managing segments... Aug 23 00:04:02.119325981 (342h37m56.550406122s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 23 00:04:02.119333796 (342h37m56.550413937s) [upload=356417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 23 00:04:02.119337693 (342h37m56.550417834s) [upload=356417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:04:02.610870786 (342h37m57.041950927s) [upload=356417]: Done uploading segments... Aug 23 00:04:02.610911554 (342h37m57.041991695s) [upload=356417]: Upload finished. err: <nil> Duration:* 1.614664725s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X..X.X.................X...........................X.....] duration: 6.199821978s FAIL (2025-08-23 00:03:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.199845172s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X..................X........................................] duration: 1.998795415s FAIL (2025-08-23 00:03:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.998824301s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X..X.X.................X...........................X....] duration: 6.176961083s FAIL (2025-08-23 00:03:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.177015387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.385498503s FAIL (2025-08-23 00:03:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.385537638s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X..................X.......................................] duration: 2.070660892s FAIL (2025-08-23 00:03:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.070689888s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.238955948s FAIL (2025-08-23 00:02:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.238986216s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X..X.X.................X...........................X...] duration: 6.091765762s FAIL (2025-08-23 00:02:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.091792723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X..................X......................................] duration: 2.122972796s FAIL (2025-08-23 00:02:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.123005958s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X..X.X.................X...........................X..] duration: 6.094679628s FAIL (2025-08-23 00:01:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.09470658s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.112408009s FAIL (2025-08-23 00:01:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.112432275s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X..................X.....................................] duration: 2.164399629s FAIL (2025-08-23 00:01:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.164428184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X..X.X.................X...........................X.] duration: 6.247351097s FAIL (2025-08-23 00:01:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.247381595s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.193942235s FAIL (2025-08-23 00:00:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.193974007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X..................X....................................] duration: 2.044792546s FAIL (2025-08-23 00:00:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.044823164s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.478420272s FAIL (2025-08-23 00:00:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.478456542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X..X.X.................X...........................X] duration: 6.457307295s FAIL (2025-08-23 00:00:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b864813dc995efb90e8ae88368fa1705b65c32decb6ab57cfcebdc9db511a747 != before 498f886a2fa449f148bb18324da722e6eccef252be7625925c7bf4967d8f3d1b ======LOGS====== Aug 22 23:59:56.704855904 (342h33m51.135936035s) [upload=356351]: Starting upload Aug 22 23:59:56.704903024 (342h33m51.135983155s) [upload=356351]: Done starting upload Aug 22 23:59:56.704992586 (342h33m51.136072717s) [upload=356351]: Uploading segments... Aug 22 23:59:56.705080634 (342h33m51.136160765s) [upload=356351]: Got next segment. Inline: false Aug 22 23:59:56.705106113 (342h33m51.136186244s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:59:56.705111243 (342h33m51.136191364s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:59:57.201194161 (342h33m51.632274292s) [seg_pos={0 0}, upload=356351]: Begin upload segment... Aug 22 23:59:57.201254216 (342h33m51.632334347s) [seg_pos={0 0}, upload=356351]: Done begin upload segment. Aug 22 23:59:57.201276839 (342h33m51.63235697s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201319500 (342h33m51.632399631s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201647388 (342h33m51.632727519s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201789449 (342h33m51.63286958s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.201963974 (342h33m51.633044105s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202113750 (342h33m51.633193881s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202240703 (342h33m51.633320834s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202402132 (342h33m51.633482263s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202523945 (342h33m51.633604076s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.202806365 (342h33m51.633886486s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203053247 (342h33m51.634133378s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203270563 (342h33m51.634350684s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203478411 (342h33m51.634558542s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203687250 (342h33m51.634767381s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.203892914 (342h33m51.634973045s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204087106 (342h33m51.635167237s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204328127 (342h33m51.635408258s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:57.204537297 (342h33m51.635617428s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Uploading piece... Aug 22 23:59:58.363287132 (342h33m52.794367253s) [upload=356351]: Next returned nil segment Aug 22 23:59:58.363302961 (342h33m52.794383092s) [upload=356351]: Waiting for error group managing segments... Aug 22 23:59:58.656689253 (342h33m53.087769384s) [noise=true , address=64.49.13.169:4706 , piece_id=7GSWMNYAC2A54PIQKEW5KZ3SSHMQRGYBFKT6WYASNFBZHICBSVTQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.228915072 (342h33m53.659995203s) [noise=true , address=104.36.82.55:4215 , piece_id=YLHYCKE2A5DKNY7UGIJEQW5VCDYKJYDDYVJPNIYOTBRS3Z6LFJ4A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.249725731 (342h33m53.680805862s) [noise=true , address=104.36.82.10:4111 , piece_id=46KBNN2DXAOFEGMOAIQXSSES2KXSHHWTD2PSUJ5HMDSM43QXVZQQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.275168252 (342h33m53.706248373s) [noise=true , address=104.36.82.41:4793 , piece_id=SUS3KOHJVFX2OJLY4GGPHSDJRGFJUOFHQ7ECXTDCSCCTCONCJLDA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.293447226 (342h33m53.724527367s) [noise=true , address=45.91.116.8:4070 , piece_id=SSFHJW5YMK3GAP57UWGMAI43D3QC5QIGRJUQUBHBUURT6ZVP6MPA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.322148362 (342h33m53.753228493s) [noise=true , address=104.36.82.61:4391 , piece_id=6TIPCF53CZCN4MPWTAGEQY6XMUW2WM7OW7U5TMPIXMMUBJNGXJIQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.332969247 (342h33m53.764049378s) [noise=true , address=104.36.82.39:4760 , piece_id=TCDX7VVDE7KZZISURMFH4Y7PPK5SU6BYASISCZUJ42JNQYPNYVSA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.418759256 (342h33m53.849839377s) [noise=true , address=77.90.31.16:4754 , piece_id=HLBMSUU7BBJRI74GE6FJ62N5XNLWOEA3U6T2WTR5LOSLEVR2GLJA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.467756466 (342h33m53.898836588s) [noise=true , address=104.36.82.43:4864 , piece_id=35OUVW5F7U2U5YIRBNOYJBWKGHVHVRGN5NXZ2XJX2W6AN4O7YJ7Q, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.541339410 (342h33m53.972419531s) [noise=true , address=77.90.31.19:4874 , piece_id=CKXJQ754OFTPJQ65LXV7OVFT5RRJN5XK2RG3NXFQPSCBG5PVVPBA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.545190428 (342h33m53.976270549s) [noise=true , address=77.90.31.10:4531 , piece_id=OXEF2LV6UNHZK35D7OSQWYPO2ENKCSPRP6RDZB33EQVXFICD2K3A, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.594856027 (342h33m54.025936158s) [noise=true , address=45.91.116.11:4140 , piece_id=DYBNGRALXXWHCERTPFJMQF37L2FAFQ4DXTC7TL2IW77U5K2H4FGA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.677562336 (342h33m54.108642467s) [noise=true , address=104.36.82.20:4440 , piece_id=QYIC76K2CYPMSMD3MRB26272ADTQANOR4PC6L2QYY2XC3N62QAGQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740486254 (342h33m54.171566385s) [noise=true , address=104.36.82.13:4195 , piece_id=FZTLQEODC7Q4TDC4BTBRWL4UNG44T3Z7HJSUBGINA6MPSQZZBOMA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: <nil> Aug 22 23:59:59.740878173 (342h33m54.171958344s) [seg_pos={0 0}, upload=356351]: Segment reached optimal threshold of 14 pieces. Aug 22 23:59:59.741066964 (342h33m54.172147096s) [noise=true , address=77.90.31.21:4882 , piece_id=NGF54U2MPRGZEN5ZCINTCZLEJAZT2EKFE4V7SG4ATQWU3ZABWLXA, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741100328 (342h33m54.172180459s) [noise=true , address=104.36.82.23:4465 , piece_id=U7H6QS7WIKWDUDD7LAW6IGGZHI47DDT3F5AB7LMPWQ7TVBU7MAPQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mt7mGfsy6qpxmZTiKcFavb3o8zYLJdk3tXDtGReLLyBkgu2jw): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741122831 (342h33m54.172202962s) [noise=true , address=104.36.82.7:4937 , piece_id=CDZJVAUD2DV53MAZILADV54YIAP2ZB65REGZTDMHMFP5SKSM4FHQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244drkeyc94qojgXAjt8oenBaGpzQBiMmisCjfBys5sLW4GvqU): protocol: expected piece hash; context canceled; EOF Aug 22 23:59:59.741189499 (342h33m54.172269631s) [noise=true , address=104.36.82.7:4929 , piece_id=5JN7WAHNNFEQO2FOB3IBEWVSF6WXHAG4U2V33L7TJIOXOTLTACJQ, seg_pos={0 0}, upload=356351]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAQMW1ZMUbDAfcEGTmeeBfWqz3tjbPwz33XvWSAxZLsgts1wT): protocol: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43004->104.36.82.7:4929: use of closed network connection Aug 22 23:59:59.741213055 (342h33m54.172293186s) [seg_pos={0 0}, upload=356351]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:59:59.741280533 (342h33m54.172360664s) [upload=356351]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:59:59.741284741 (342h33m54.172364872s) [upload=356351]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 23 00:00:00.106169155 (342h33m54.537249296s) [upload=356351]: Done uploading segments... Aug 23 00:00:00.106190136 (342h33m54.537270277s) [upload=356351]: Upload finished. err: <nil> Duration: 6.457354485s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X..................X...................................] duration: 1.931855794s FAIL (2025-08-22 23:59:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.931892393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.1203268s FAIL (2025-08-22 23:59:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 6.120356508s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X..X.X.................X...........................] duration: 6.296568101s FAIL (2025-08-22 23:59:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 23:36:44.319407821 (342h10m38.750487952s) [upload=355963]: Starting upload Aug 22 23:36:44.319472084 (342h10m38.750552215s) [upload=355963]: Done starting upload Aug 22 23:36:44.319557708 (342h10m38.750637839s) [upload=355963]: Uploading segments... Aug 22 23:36:44.319744686 (342h10m38.750824817s) [upload=355963]: Got next segment. Inline: false Aug 22 23:36:44.319794632 (342h10m38.750874763s) [upload=355963]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:36:44.319800713 (342h10m38.750880844s) [upload=355963]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:36:44.773013682 (342h10m39.204093813s) [seg_pos={0 0}, upload=355963]: Begin upload segment... Aug 22 23:36:44.773057476 (342h10m39.204137607s) [seg_pos={0 0}, upload=355963]: Done begin upload segment. Aug 22 23:36:44.773075811 (342h10m39.204155932s) [noise=true , address=64.49.13.140:4514 , piece_id=LRJAQDESPQ4JJNEMWV6YLYBDWLAQZMGO5H5CQL2PTKBEZKZVUCTA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773127770 (342h10m39.204207901s) [noise=true , address=104.36.82.13:4197 , piece_id=ILQFNTRAWHNMXRDHOYWU7H5TX2NQQG4EVGDOCR453N5WGQL5F2KA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773445338 (342h10m39.204525469s) [noise=true , address=104.36.82.14:4233 , piece_id=MZWD7CWEVQR7GBSPIMESQFL47LLHMRXPHFGB6NZFJ2NKYQ4W2F6Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773656212 (342h10m39.204736343s) [noise=true , address=45.91.116.8:4075 , piece_id=7ANFI6VFQRTZMTJHLG7KOI7BPAUFTP7557QO4ZOO4MBKLMMSBKIA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773719422 (342h10m39.204799543s) [noise=true , address=104.36.82.44:4899 , piece_id=YAPAI3AXEMFE7L7S6BE37ZGN5DMDAQQFOYQKX3YLXTZSWSETYSYQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773998516 (342h10m39.205078647s) [noise=true , address=79.127.219.47:4069 , piece_id=CAXUOW3CA3K4ZBKNJ5ODCCV5QK2F45CZ4BGEEGDVTMQ4KW3EEMCA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774006551 (342h10m39.205086682s) [noise=true , address=77.90.31.13:4655 , piece_id=OYLFBGJ74VRA3YARW6USPKA2TQ6VQERYLWXWXO3VJAFYJ4M6IQZA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774272771 (342h10m39.205352892s) [noise=true , address=104.36.82.7:4940 , piece_id=QKCSI4PUK6HBWEJVQA4SMQIUKS3CAB4IJ3DQGYNAVWRKHKLXSGOA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774375077 (342h10m39.205455208s) [noise=true , address=45.91.116.4:4950 , piece_id=S4TAGDNMGMW5L25U4NBRDPINGARQDQMODDKD4STWAN3BRBN64O2A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774533581 (342h10m39.205613712s) [noise=true , address=104.36.82.38:4690 , piece_id=KFPFUCSZ2AHOJQZJRF727QAZD47ABMRNNE5US6WOOMYAHYGLJS5A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774701181 (342h10m39.205781302s) [noise=true , address=77.90.31.18:4826 , piece_id=6QI5QMOUQZNA7VAEBGB3SSHP3NPWZUEHYVOGVWWKH7LMUJVDZ72Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774763520 (342h10m39.205843651s) [noise=true , address=104.36.82.12:4168 , piece_id=YGUKDRQTLR4CKI5UON6PN44VIRTX3YZ3AMUFLJNYVLQC4YFK2D7Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774961258 (342h10m39.206041389s) [noise=true , address=79.127.220.97:4384 , piece_id=IWCA3I4MGV6XNQ4EF2UEVZVB5MQYAFC5S6CKTYMX7C35MKMX2ZZQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774975496 (342h10m39.206055627s) [noise=true , address=104.36.82.60:4340 , piece_id=KSRGCI4CQP3X7FFRGDRDJ5PPXUVE6QLCRYQCOPRTBQFY6SOSGX5A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775180127 (342h10m39.206260258s) [noise=true , address=104.36.82.3:4794 , piece_id=FT7DRL5YWDWX5JXC4ATGOWRD4V33K3TGOOE6HX4N2QHVLTDIRBSA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775235683 (342h10m39.206315814s) [noise=true , address=104.36.82.2:4760 , piece_id=NZHIFK4GOCAAMSFIFKU7VB2TZAACD2YEVXPGFHWKYW3Z5HNJQOWQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775400118 (342h10m39.206480249s) [noise=true , address=104.36.82.11:4118 , piece_id=VQFM747ZG4H42HHQOPM4MITU7LDIHKDO4WRRDHIT3JFK5G6FDSWQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775541839 (342h10m39.20662197s) [noise=true , address=104.36.82.37:4688 , piece_id=7XFOGRPO5TJWSSOUVJHYEZFMIFIPISA6SBTXEV5KZLBF3K36GHAQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:45.945484795 (342h10m40.376564916s) [upload=355963]: Next returned nil segment Aug 22 23:36:45.945515284 (342h10m40.376595415s) [upload=355963]: Waiting for error group managing segments... Aug 22 23:36:46.241543578 (342h10m40.672623709s) [noise=true , address=64.49.13.140:4514 , piece_id=LRJAQDESPQ4JJNEMWV6YLYBDWLAQZMGO5H5CQL2PTKBEZKZVUCTA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.630449964 (342h10m41.061530095s) [noise=true , address=79.127.220.97:4384 , piece_id=IWCA3I4MGV6XNQ4EF2UEVZVB5MQYAFC5S6CKTYMX7C35MKMX2ZZQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.718644594 (342h10m41.149724725s) [noise=true , address=104.36.82.38:4690 , piece_id=KFPFUCSZ2AHOJQZJRF727QAZD47ABMRNNE5US6WOOMYAHYGLJS5A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.734394540 (342h10m41.165474671s) [noise=true , address=79.127.219.47:4069 , piece_id=CAXUOW3CA3K4ZBKNJ5ODCCV5QK2F45CZ4BGEEGDVTMQ4KW3EEMCA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.745683840 (342h10m41.176763961s) [noise=true , address=45.91.116.8:4075 , piece_id=7ANFI6VFQRTZMTJHLG7KOI7BPAUFTP7557QO4ZOO4MBKLMMSBKIA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.813775636 (342h10m41.244855777s) [noise=true , address=104.36.82.3:4794 , piece_id=FT7DRL5YWDWX5JXC4ATGOWRD4V33K3TGOOE6HX4N2QHVLTDIRBSA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.844514922 (342h10m41.275595053s) [noise=true , address=104.36.82.37:4688 , piece_id=7XFOGRPO5TJWSSOUVJHYEZFMIFIPISA6SBTXEV5KZLBF3K36GHAQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.845068261 (342h10m41.276148392s) [noise=true , address=104.36.82.13:4197 , piece_id=ILQFNTRAWHNMXRDHOYWU7H5TX2NQQG4EVGDOCR453N5WGQL5F2KA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.849125945 (342h10m41.280206066s) [noise=true , address=104.36.82.7:4940 , piece_id=QKCSI4PUK6HBWEJVQA4SMQIUKS3CAB4IJ3DQGYNAVWRKHKLXSGOA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.859193688 (342h10m41.290273819s) [noise=true , address=104.36.82.11:4118 , piece_id=VQFM747ZG4H42HHQOPM4MITU7LDIHKDO4WRRDHIT3JFK5G6FDSWQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.864962355 (342h10m41.296042487s) [noise=true , address=104.36.82.12:4168 , piece_id=YGUKDRQTLR4CKI5UON6PN44VIRTX3YZ3AMUFLJNYVLQC4YFK2D7Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.913072930 (342h10m41.344153061s) [noise=true , address=77.90.31.13:4655 , piece_id=OYLFBGJ74VRA3YARW6USPKA2TQ6VQERYLWXWXO3VJAFYJ4M6IQZA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.938088935 (342h10m41.369169056s) [noise=true , address=104.36.82.44:4899 , piece_id=YAPAI3AXEMFE7L7S6BE37ZGN5DMDAQQFOYQKX3YLXTZSWSETYSYQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.957746086 (342h10m41.388826217s) [noise=true , address=104.36.82.2:4760 , piece_id=NZHIFK4GOCAAMSFIFKU7VB2TZAACD2YEVXPGFHWKYW3Z5HNJQOWQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.957770623 (342h10m41.388850744s) [seg_pos={0 0}, upload=355963]: Segment reached optimal threshold of 14 pieces. Aug 22 23:36:46.957894030 (342h10m41.388974161s) [noise=true , address=104.36.82.60:4340 , piece_id=KSRGCI4CQP3X7FFRGDRDJ5PPXUVE6QLCRYQCOPRTBQFY6SOSGX5A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.957934046 (342h10m41.389014177s) [noise=true , address=45.91.116.4:4950 , piece_id=S4TAGDNMGMW5L25U4NBRDPINGARQDQMODDKD4STWAN3BRBN64O2A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yLCMLdMxDT9HviM2QRVvP1hkektw7WmGxm8QVpp7h7ZVexkjy): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.957988079 (342h10m41.38906821s) [noise=true , address=104.36.82.14:4233 , piece_id=MZWD7CWEVQR7GBSPIMESQFL47LLHMRXPHFGB6NZFJ2NKYQ4W2F6Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.958067602 (342h10m41.389147733s) [noise=true , address=77.90.31.18:4826 , piece_id=6QI5QMOUQZNA7VAEBGB3SSHP3NPWZUEHYVOGVWWKH7LMUJVDZ72Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.958107599 (342h10m41.38918773s) [seg_pos={0 0}, upload=355963]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:36:46.958204504 (342h10m41.389284635s) [upload=355963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:36:46.958209773 (342h10m41.389289905s) [upload=355963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:36:47.291790801 (342h10m41.722870952s) [upload=355963]: Done uploading segments... Aug 22 23:36:47.291812182 (342h10m41.722892323s) [upload=355963]: Upload finished. err: <nil> Duration: 6.296598839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.236952154s FAIL (2025-08-22 23:58:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece... Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.236969558s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X..................X..................................] duration: 2.089803026s FAIL (2025-08-22 23:58:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:32:27.296146894 (342h6m21.727227025s) [upload=355884]: Starting upload Aug 22 23:32:27.296189575 (342h6m21.727269706s) [upload=355884]: Done starting upload Aug 22 23:32:27.296236025 (342h6m21.727316156s) [upload=355884]: Uploading segments... Aug 22 23:32:27.296273205 (342h6m21.727353336s) [upload=355884]: Got next segment. Inline: true Aug 22 23:32:27.296276952 (342h6m21.727357083s) [upload=355884]: Waiting for error group managing segments... Aug 22 23:32:27.296304796 (342h6m21.727384927s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:32:27.296309304 (342h6m21.727389435s) [upload=355884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 23:32:27.296311980 (342h6m21.727392111s) [upload=355884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:32:27.569014263 (342h6m22.000094394s) [upload=355884]: Done uploading segments... Aug 22 23:32:27.569030394 (342h6m22.000110525s) [upload=355884]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.089826682s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X..X.X.................X..........................] duration: 6.109964606s FAIL (2025-08-22 23:58:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 23:36:44.319407821 (342h10m38.750487952s) [upload=355963]: Starting upload Aug 22 23:36:44.319472084 (342h10m38.750552215s) [upload=355963]: Done starting upload Aug 22 23:36:44.319557708 (342h10m38.750637839s) [upload=355963]: Uploading segments... Aug 22 23:36:44.319744686 (342h10m38.750824817s) [upload=355963]: Got next segment. Inline: false Aug 22 23:36:44.319794632 (342h10m38.750874763s) [upload=355963]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 23:36:44.319800713 (342h10m38.750880844s) [upload=355963]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 23:36:44.773013682 (342h10m39.204093813s) [seg_pos={0 0}, upload=355963]: Begin upload segment... Aug 22 23:36:44.773057476 (342h10m39.204137607s) [seg_pos={0 0}, upload=355963]: Done begin upload segment. Aug 22 23:36:44.773075811 (342h10m39.204155932s) [noise=true , address=64.49.13.140:4514 , piece_id=LRJAQDESPQ4JJNEMWV6YLYBDWLAQZMGO5H5CQL2PTKBEZKZVUCTA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773127770 (342h10m39.204207901s) [noise=true , address=104.36.82.13:4197 , piece_id=ILQFNTRAWHNMXRDHOYWU7H5TX2NQQG4EVGDOCR453N5WGQL5F2KA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773445338 (342h10m39.204525469s) [noise=true , address=104.36.82.14:4233 , piece_id=MZWD7CWEVQR7GBSPIMESQFL47LLHMRXPHFGB6NZFJ2NKYQ4W2F6Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773656212 (342h10m39.204736343s) [noise=true , address=45.91.116.8:4075 , piece_id=7ANFI6VFQRTZMTJHLG7KOI7BPAUFTP7557QO4ZOO4MBKLMMSBKIA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773719422 (342h10m39.204799543s) [noise=true , address=104.36.82.44:4899 , piece_id=YAPAI3AXEMFE7L7S6BE37ZGN5DMDAQQFOYQKX3YLXTZSWSETYSYQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.773998516 (342h10m39.205078647s) [noise=true , address=79.127.219.47:4069 , piece_id=CAXUOW3CA3K4ZBKNJ5ODCCV5QK2F45CZ4BGEEGDVTMQ4KW3EEMCA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774006551 (342h10m39.205086682s) [noise=true , address=77.90.31.13:4655 , piece_id=OYLFBGJ74VRA3YARW6USPKA2TQ6VQERYLWXWXO3VJAFYJ4M6IQZA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774272771 (342h10m39.205352892s) [noise=true , address=104.36.82.7:4940 , piece_id=QKCSI4PUK6HBWEJVQA4SMQIUKS3CAB4IJ3DQGYNAVWRKHKLXSGOA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774375077 (342h10m39.205455208s) [noise=true , address=45.91.116.4:4950 , piece_id=S4TAGDNMGMW5L25U4NBRDPINGARQDQMODDKD4STWAN3BRBN64O2A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774533581 (342h10m39.205613712s) [noise=true , address=104.36.82.38:4690 , piece_id=KFPFUCSZ2AHOJQZJRF727QAZD47ABMRNNE5US6WOOMYAHYGLJS5A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774701181 (342h10m39.205781302s) [noise=true , address=77.90.31.18:4826 , piece_id=6QI5QMOUQZNA7VAEBGB3SSHP3NPWZUEHYVOGVWWKH7LMUJVDZ72Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774763520 (342h10m39.205843651s) [noise=true , address=104.36.82.12:4168 , piece_id=YGUKDRQTLR4CKI5UON6PN44VIRTX3YZ3AMUFLJNYVLQC4YFK2D7Q, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774961258 (342h10m39.206041389s) [noise=true , address=79.127.220.97:4384 , piece_id=IWCA3I4MGV6XNQ4EF2UEVZVB5MQYAFC5S6CKTYMX7C35MKMX2ZZQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.774975496 (342h10m39.206055627s) [noise=true , address=104.36.82.60:4340 , piece_id=KSRGCI4CQP3X7FFRGDRDJ5PPXUVE6QLCRYQCOPRTBQFY6SOSGX5A, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775180127 (342h10m39.206260258s) [noise=true , address=104.36.82.3:4794 , piece_id=FT7DRL5YWDWX5JXC4ATGOWRD4V33K3TGOOE6HX4N2QHVLTDIRBSA, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775235683 (342h10m39.206315814s) [noise=true , address=104.36.82.2:4760 , piece_id=NZHIFK4GOCAAMSFIFKU7VB2TZAACD2YEVXPGFHWKYW3Z5HNJQOWQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775400118 (342h10m39.206480249s) [noise=true , address=104.36.82.11:4118 , piece_id=VQFM747ZG4H42HHQOPM4MITU7LDIHKDO4WRRDHIT3JFK5G6FDSWQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:44.775541839 (342h10m39.20662197s) [noise=true , address=104.36.82.37:4688 , piece_id=7XFOGRPO5TJWSSOUVJHYEZFMIFIPISA6SBTXEV5KZLBF3K36GHAQ, seg_pos={0 0}, upload=355963]: Uploading piece... Aug 22 23:36:45.945484795 (342h10m40.376564916s) [upload=355963]: Next returned nil segment Aug 22 23:36:45.945515284 (342h10m40.376595415s) [upload=355963]: Waiting for error group managing segments... Aug 22 23:36:46.241543578 (342h10m40.672623709s) [noise=true , address=64.49.13.140:4514 , piece_id=LRJAQDESPQ4JJNEMWV6YLYBDWLAQZMGO5H5CQL2PTKBEZKZVUCTA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.630449964 (342h10m41.061530095s) [noise=true , address=79.127.220.97:4384 , piece_id=IWCA3I4MGV6XNQ4EF2UEVZVB5MQYAFC5S6CKTYMX7C35MKMX2ZZQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.718644594 (342h10m41.149724725s) [noise=true , address=104.36.82.38:4690 , piece_id=KFPFUCSZ2AHOJQZJRF727QAZD47ABMRNNE5US6WOOMYAHYGLJS5A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.734394540 (342h10m41.165474671s) [noise=true , address=79.127.219.47:4069 , piece_id=CAXUOW3CA3K4ZBKNJ5ODCCV5QK2F45CZ4BGEEGDVTMQ4KW3EEMCA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.745683840 (342h10m41.176763961s) [noise=true , address=45.91.116.8:4075 , piece_id=7ANFI6VFQRTZMTJHLG7KOI7BPAUFTP7557QO4ZOO4MBKLMMSBKIA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.813775636 (342h10m41.244855777s) [noise=true , address=104.36.82.3:4794 , piece_id=FT7DRL5YWDWX5JXC4ATGOWRD4V33K3TGOOE6HX4N2QHVLTDIRBSA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.844514922 (342h10m41.275595053s) [noise=true , address=104.36.82.37:4688 , piece_id=7XFOGRPO5TJWSSOUVJHYEZFMIFIPISA6SBTXEV5KZLBF3K36GHAQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.845068261 (342h10m41.276148392s) [noise=true , address=104.36.82.13:4197 , piece_id=ILQFNTRAWHNMXRDHOYWU7H5TX2NQQG4EVGDOCR453N5WGQL5F2KA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.849125945 (342h10m41.280206066s) [noise=true , address=104.36.82.7:4940 , piece_id=QKCSI4PUK6HBWEJVQA4SMQIUKS3CAB4IJ3DQGYNAVWRKHKLXSGOA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.859193688 (342h10m41.290273819s) [noise=true , address=104.36.82.11:4118 , piece_id=VQFM747ZG4H42HHQOPM4MITU7LDIHKDO4WRRDHIT3JFK5G6FDSWQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.864962355 (342h10m41.296042487s) [noise=true , address=104.36.82.12:4168 , piece_id=YGUKDRQTLR4CKI5UON6PN44VIRTX3YZ3AMUFLJNYVLQC4YFK2D7Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.913072930 (342h10m41.344153061s) [noise=true , address=77.90.31.13:4655 , piece_id=OYLFBGJ74VRA3YARW6USPKA2TQ6VQERYLWXWXO3VJAFYJ4M6IQZA, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.938088935 (342h10m41.369169056s) [noise=true , address=104.36.82.44:4899 , piece_id=YAPAI3AXEMFE7L7S6BE37ZGN5DMDAQQFOYQKX3YLXTZSWSETYSYQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.957746086 (342h10m41.388826217s) [noise=true , address=104.36.82.2:4760 , piece_id=NZHIFK4GOCAAMSFIFKU7VB2TZAACD2YEVXPGFHWKYW3Z5HNJQOWQ, seg_pos={0 0}, upload=355963]: Done uploading piece. err: <nil> Aug 22 23:36:46.957770623 (342h10m41.388850744s) [seg_pos={0 0}, upload=355963]: Segment reached optimal threshold of 14 pieces. Aug 22 23:36:46.957894030 (342h10m41.388974161s) [noise=true , address=104.36.82.60:4340 , piece_id=KSRGCI4CQP3X7FFRGDRDJ5PPXUVE6QLCRYQCOPRTBQFY6SOSGX5A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.957934046 (342h10m41.389014177s) [noise=true , address=45.91.116.4:4950 , piece_id=S4TAGDNMGMW5L25U4NBRDPINGARQDQMODDKD4STWAN3BRBN64O2A, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yLCMLdMxDT9HviM2QRVvP1hkektw7WmGxm8QVpp7h7ZVexkjy): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.957988079 (342h10m41.38906821s) [noise=true , address=104.36.82.14:4233 , piece_id=MZWD7CWEVQR7GBSPIMESQFL47LLHMRXPHFGB6NZFJ2NKYQ4W2F6Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.958067602 (342h10m41.389147733s) [noise=true , address=77.90.31.18:4826 , piece_id=6QI5QMOUQZNA7VAEBGB3SSHP3NPWZUEHYVOGVWWKH7LMUJVDZ72Q, seg_pos={0 0}, upload=355963]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v6coC31yHW7RcRYPsoUqoYdgS7mrzUHWGMdH2Hma2QC7qe8JQ): protocol: expected piece hash; context canceled; EOF Aug 22 23:36:46.958107599 (342h10m41.38918773s) [seg_pos={0 0}, upload=355963]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 23:36:46.958204504 (342h10m41.389284635s) [upload=355963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 23:36:46.958209773 (342h10m41.389289905s) [upload=355963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 23:36:47.291790801 (342h10m41.722870952s) [upload=355963]: Done uploading segments... Aug 22 23:36:47.291812182 (342h10m41.722892323s) [upload=355963]: Upload finished. err: <nil> Duration: 6.10999375s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)