Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X................X.....................X..................] duration: 2.525881091s FAIL (2025-08-28 03:31:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.525909795s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX....X..........................] duration: 1.609356919s FAIL (2025-08-28 03:31:24 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.609383239s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 5.171886457s FAIL (2025-08-28 03:31:21 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.171914731s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 19.514741686s FAIL (2025-08-28 03:31:16 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 19.514779337s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X................X.....................X.................] duration: 2.044554659s FAIL (2025-08-28 03:31:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.044586388s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.............X...................................] duration: 6.457910818s FAIL (2025-08-28 03:30:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.457933201s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................XX....X.........................] duration: 14.125340449s FAIL (2025-08-28 03:30:48 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 14.125372981s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X................X.....................X................] duration: 2.064389159s FAIL (2025-08-28 03:30:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.064418836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................XX....X........................] duration: 1.430085883s FAIL (2025-08-28 03:29:53 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.43011075s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..........X.............X..................................] duration: 6.361473936s FAIL (2025-08-28 03:29:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.361503694s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 4.902437441s FAIL (2025-08-28 03:29:51 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.902465195s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X................X.....................X...............] duration: 1.898750684s FAIL (2025-08-28 03:29:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.898780781s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 4.97293119s FAIL (2025-08-28 03:29:00 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.972967249s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..........X.............X.................................] duration: 5.622014046s FAIL (2025-08-28 03:28:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 5.622042109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................XX....X.......................] duration: 1.53231304s FAIL (2025-08-28 03:28:49 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.532343148s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X................X.....................X..............] duration: 1.996539276s FAIL (2025-08-28 03:28:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.996573421s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................XX....X......................] duration: 1.462345075s FAIL (2025-08-28 03:28:18 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.462372628s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 13.25800857s FAIL (2025-08-28 03:28:05 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 13.258040841s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..........X.............X................................] duration: 6.192849522s FAIL (2025-08-28 03:27:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.192872606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................XX....X.....................] duration: 1.414672948s FAIL (2025-08-28 03:27:45 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.4147003s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X................X.....................X.............] duration: 2.08023496s FAIL (2025-08-28 03:27:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.080388063s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................XX....X....................] duration: 1.39727656s FAIL (2025-08-28 03:27:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.397299234s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..........X.............X...............................] duration: 5.695132176s FAIL (2025-08-28 03:27:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 5.695162683s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X................X.....................X............] duration: 1.884132795s FAIL (2025-08-28 03:27:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.884162983s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 4.873798538s FAIL (2025-08-28 03:26:48 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.873826231s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X................X.....................X...........] duration: 1.94416457s FAIL (2025-08-28 03:26:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.944196944s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 4.899331824s FAIL (2025-08-28 03:26:25 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.899361109s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..........X.............X..............................] duration: 5.886446375s FAIL (2025-08-28 03:26:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 5.886471414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................XX....X...................] duration: 1.467980968s FAIL (2025-08-28 03:26:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.468008891s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................XX....X..................] duration: 1.406791497s FAIL (2025-08-28 03:25:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.406816014s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X..........X.............X.............................] duration: 6.062269229s FAIL (2025-08-28 03:25:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.06229606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 4.917287382s FAIL (2025-08-28 03:25:26 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.917320175s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X................X.....................X..........] duration: 2.036060907s FAIL (2025-08-28 03:25:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.036108288s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X..........X.............X............................] duration: 5.799398289s FAIL (2025-08-28 03:24:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 5.799420011s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................XX....X.................] duration: 1.48630508s FAIL (2025-08-28 03:24:32 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.486331198s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 4.873369438s FAIL (2025-08-28 03:24:24 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.873403652s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X................X.....................X.........] duration: 2.083019818s FAIL (2025-08-28 03:24:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.08304718s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 11.585193909s FAIL (2025-08-28 03:24:14 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 11.585233515s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................XX....X................] duration: 1.586004965s FAIL (2025-08-28 03:23:40 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.586027239s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X..........X.............X...........................] duration: 6.159385511s FAIL (2025-08-28 03:23:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.159420519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 12.401285369s FAIL (2025-08-28 03:23:25 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 12.401322949s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X................X.....................X........] duration: 2.0619114s FAIL (2025-08-28 03:23:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.061951707s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X..........X.............X..........................] duration: 6.046042853s FAIL (2025-08-28 03:23:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.046073292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................XX....X...............] duration: 1.515298435s FAIL (2025-08-28 03:22:56 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.515408215s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..........X.............X.........................] duration: 5.941304053s FAIL (2025-08-28 03:22:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 5.941336253s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 5.030536362s FAIL (2025-08-28 03:22:45 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.03056163s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X................X.....................X.......] duration: 2.05233206s FAIL (2025-08-28 03:22:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.052370123s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................XX....X..............] duration: 10.031251882s FAIL (2025-08-28 03:22:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 10.031283644s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 4.955269928s FAIL (2025-08-28 03:21:57 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.955300615s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X..........X.............X........................] duration: 6.086338432s FAIL (2025-08-28 03:21:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e209a8d13687cf7a6f02df6b45d8d12c524c85e633e9df56a30516eb5087b9bf != before 60324e0e8d7f54d8981dc3b988ba817dd02f561f902eb2a587ac34c2bd25ef40 ======LOGS====== Aug 28 03:05:47.763806534 (9h27m26.926407503s) [upload=9892]: Starting upload Aug 28 03:05:47.763911796 (9h27m26.926512734s) [upload=9892]: Done starting upload Aug 28 03:05:47.764016726 (9h27m26.926617724s) [upload=9892]: Uploading segments... Aug 28 03:05:47.764358060 (9h27m26.926959038s) [upload=9892]: Got next segment. Inline: false Aug 28 03:05:47.764422422 (9h27m26.927023411s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:05:47.764431030 (9h27m26.927032008s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:05:48.234221246 (9h27m27.396822184s) [seg_pos={0 0}, upload=9892]: Begin upload segment... Aug 28 03:05:48.234259661 (9h27m27.396860589s) [seg_pos={0 0}, upload=9892]: Done begin upload segment. Aug 28 03:05:48.234284498 (9h27m27.396885436s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234673122 (9h27m27.39727406s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.234960281 (9h27m27.397561219s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235236549 (9h27m27.397837487s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235508530 (9h27m27.398109468s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235738500 (9h27m27.398339438s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.235962919 (9h27m27.398563847s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236175156 (9h27m27.398776094s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236393464 (9h27m27.398994402s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236580681 (9h27m27.399181619s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.236811142 (9h27m27.399412081s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237001377 (9h27m27.399602315s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237201249 (9h27m27.399802187s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237392154 (9h27m27.399993092s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237580695 (9h27m27.400181633s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237768554 (9h27m27.400369493s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.237992633 (9h27m27.400593561s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:48.238284462 (9h27m27.4008854s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Uploading piece... Aug 28 03:05:49.387031227 (9h27m28.549632165s) [upload=9892]: Next returned nil segment Aug 28 03:05:49.387133704 (9h27m28.549734652s) [upload=9892]: Waiting for error group managing segments... Aug 28 03:05:49.675680084 (9h27m28.838281022s) [noise=true , address=79.127.205.234:4610 , piece_id=TMSWYHRYL2BSUNAFLDOGUDCESCY3R5XFLSFUMS45QTTEF7W37E6A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.760536010 (9h27m28.923136938s) [noise=true , address=64.49.13.140:4508 , piece_id=IZF7CQVMQ4YEJ2IZ4UIVKPMYBB5EDG6KGWVV2LQHJVTVFGY6ABTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:49.801388398 (9h27m28.963989336s) [noise=true , address=79.127.205.246:4278 , piece_id=LLRUSFY7JDFYJX4SV6GWQWFM57D4A73PBMPX32FFRMNYNJNGVPIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.123396896 (9h27m29.285997834s) [noise=true , address=77.90.31.11:4574 , piece_id=V36GJKMBWGXOWA7QADHC3AXAXIG6E46EGXL6SZTGNFVMGQH75IYQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.127851609 (9h27m29.290452557s) [noise=true , address=45.91.116.13:4170 , piece_id=S3OHCRDT7XQ6IE6W43XKOQQ3ZTJA4A4XOBQ7ZMIWLGRO3VZ3AH5A, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.129364594 (9h27m29.291965532s) [noise=true , address=77.90.31.21:4885 , piece_id=XORKOHU2M3X27AOS3MZFIKIWNR2G4MB6GM5EKN4GMYR4W3KB2UUQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.138208316 (9h27m29.300809254s) [noise=true , address=77.90.31.15:4705 , piece_id=BKTQWN4U54L2T4CIUBYJMHAFDIWQTW6ECYY766DCV4JT7YXRRMIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.155487328 (9h27m29.318088267s) [noise=true , address=104.36.82.7:4915 , piece_id=4QXJ3KDOS7D43X5OSDQ5MJ6OD35CRMHRK3CZHHMDP54TIPALNUTQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.182833093 (9h27m29.345434031s) [noise=true , address=45.91.116.8:4075 , piece_id=SZUTHYVPBBDE7W66K2Y7FRFUDH6SINV34FCQ7DLCA2GEVG52GSPQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.219298215 (9h27m29.381899153s) [noise=true , address=77.90.31.16:4759 , piece_id=7MUAUANXODKE76FN5HDU6ZYZHTFRW2KTRNPGDNCNXYGHLM4OUZZA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.222611274 (9h27m29.385212213s) [noise=true , address=45.91.116.4:4941 , piece_id=5LNSDYMGEZZYUNHXUXXJFKGJV62H2WRETRCQZV6FKVMDTTT4GE7Q, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.225730693 (9h27m29.388331631s) [noise=true , address=104.36.82.5:4845 , piece_id=XYVLKRQOBYQAKCOZ6DST335JCO54GYLV3DHD6DEPUWDYCAEYLVAQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.270659441 (9h27m29.433260379s) [noise=true , address=45.91.116.10:4108 , piece_id=GVLYMNEHUGG5GA2HSN2D5EUC5EQRPK2ZICVOANU2UOQLQ5YJ2EVA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285768922 (9h27m29.44836986s) [noise=true , address=77.90.31.14:4687 , piece_id=YD3WGCQFT2DDN6BMGSXOHB7MGXQ5LAV25U5ZPBDYGI7S4O3ZWKIA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: <nil> Aug 28 03:05:50.285794541 (9h27m29.448395479s) [seg_pos={0 0}, upload=9892]: Segment reached optimal threshold of 14 pieces. Aug 28 03:05:50.285940640 (9h27m29.448541578s) [noise=true , address=77.90.31.18:4830 , piece_id=GELPZ3SG4GES6GDLNOMLS2X7SBE45Z74MTSUW42LOFS7TEZRK6MQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286069848 (9h27m29.448670786s) [noise=true , address=104.36.82.60:4357 , piece_id=DI6KFZQCETLYC576LMZDZ6WEF5XV7XDRLVI7TTLHPNP72DVO3BIQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286132117 (9h27m29.448733045s) [noise=true , address=104.36.82.52:4119 , piece_id=63YHOA45JLQCZOHNDN4URJB4CCJA4XDHL2E42BQRKIUETMNNQCTA, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mTLjL6Y6VVjqztwVXYif4v7tyftjLafztLUibajksMHCFraFG): protocol: expected piece hash; context canceled; EOF Aug 28 03:05:50.286167564 (9h27m29.448768492s) [noise=true , address=104.36.82.5:4854 , piece_id=D2FHWII2PRLTGMM24BUOWR55PQLGP3LB6RA2GRLY64M3VPBY37WQ, seg_pos={0 0}, upload=9892]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41190->104.36.82.5:4854: use of closed network connection Aug 28 03:05:50.286188635 (9h27m29.448789573s) [seg_pos={0 0}, upload=9892]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:05:50.286251655 (9h27m29.448852593s) [upload=9892]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:05:50.286255904 (9h27m29.448856842s) [upload=9892]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:05:50.596989558 (9h27m29.759590496s) [upload=9892]: Done uploading segments... Aug 28 03:05:50.597023813 (9h27m29.759624741s) [upload=9892]: Upload finished. err: <nil> Duration: 6.086368019s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)