Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.............................................X.......X.....] duration: 1.835255804s FAIL (2025-08-08 02:56:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.835282395s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X...........X.........................] duration: 5.681035907s FAIL (2025-08-08 02:56:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.681060132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.............................................X.......X....] duration: 1.889408321s FAIL (2025-08-08 02:55:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.889437788s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...........X........................] duration: 5.734573178s FAIL (2025-08-08 02:55:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.734600751s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.X.............................................X.......X...] duration: 1.850583419s FAIL (2025-08-08 02:55:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.850604439s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X...........X.......................] duration: 5.888748861s FAIL (2025-08-08 02:54:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.888773738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.X.............................................X.......X..] duration: 1.862127095s FAIL (2025-08-08 02:54:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.862162412s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X........................X...........X......................] duration: 5.618770166s FAIL (2025-08-08 02:53:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.618797398s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.............................................X.......X.] duration: 1.877966559s FAIL (2025-08-08 02:53:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.877991789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X........................X...........X.....................] duration: 5.76244719s FAIL (2025-08-08 02:53:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.762473551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.X.............................................X.......X] duration: 1.471386468s FAIL (2025-08-08 02:52:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.471411717s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X.X.............................................X.......] duration: 1.883213828s FAIL (2025-08-08 02:52:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.88324118s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X........................X...........X....................] duration: 5.647534941s FAIL (2025-08-08 02:52:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.647561662s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.X.............................................X......] duration: 1.924285972s FAIL (2025-08-08 02:51:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.924313394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X........................X...........X...................] duration: 5.801318582s FAIL (2025-08-08 02:51:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.801340864s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X........................X...........X..................] duration: 5.723578272s FAIL (2025-08-08 02:50:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.723602058s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.X.............................................X.....] duration: 1.889383706s FAIL (2025-08-08 02:50:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.889412732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X........................X...........X.................] duration: 5.791832213s FAIL (2025-08-08 02:49:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.791859015s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X.X.............................................X....] duration: 2.133721763s FAIL (2025-08-08 02:49:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 2.133751361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X........................X...........X................] duration: 6.076884045s FAIL (2025-08-08 02:49:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 6.076908062s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X.X.............................................X...] duration: 2.221320052s FAIL (2025-08-08 02:49:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 2.221348037s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X........X.X.............................................X..] duration: 2.334620539s FAIL (2025-08-08 02:48:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 2.334651479s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X........................X...........X...............] duration: 6.148411688s FAIL (2025-08-08 02:48:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 6.148430193s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 643.029666ms target: https://us1.storj.io/login FAIL (2025-08-08 02:48:04 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 643.058612ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X........X.X.............................................X.] duration: 3.074217476s FAIL (2025-08-08 02:47:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 3.074251272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X........X.X.............................................X] duration: 880.790912ms FAIL (2025-08-08 02:47:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 880.815479ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X........................X...........X..............] duration: 5.659166022s FAIL (2025-08-08 02:47:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.659194578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 646.945288ms target: https://us1.storj.io/login FAIL (2025-08-08 02:46:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 646.97657ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X........X.X.............................................] duration: 1.846765707s FAIL (2025-08-08 02:46:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.846792938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X........................X...........X.............] duration: 5.668846856s FAIL (2025-08-08 02:46:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.668935797s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 654.537837ms target: https://us1.storj.io/login FAIL (2025-08-08 02:45:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 654.576039ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 655.691412ms target: https://us1.storj.io/login FAIL (2025-08-08 02:45:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 655.714848ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X........X.X............................................] duration: 1.81390882s FAIL (2025-08-08 02:45:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.813934679s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X........................X...........X............] duration: 5.677833671s FAIL (2025-08-08 02:45:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.677858027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X........X.X...........................................] duration: 1.84923592s FAIL (2025-08-08 02:45:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.849263011s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X........................X...........X...........] duration: 5.859758833s FAIL (2025-08-08 02:45:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.859783581s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 654.948588ms target: https://us1.storj.io/login FAIL (2025-08-08 02:44:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 654.976621ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X........X.X..........................................] duration: 1.849346781s FAIL (2025-08-08 02:44:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.849374674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X........................X...........X..........] duration: 6.276425227s FAIL (2025-08-08 02:43:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 6.276450496s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 642.150993ms target: https://us1.storj.io/login FAIL (2025-08-08 02:43:19 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 642.17074ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X........X.X.........................................] duration: 2.016423787s FAIL (2025-08-08 02:43:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 2.016450329s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X........................X...........X.........] duration: 5.626486855s FAIL (2025-08-08 02:43:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.626513055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X........X.X........................................] duration: 1.851423234s FAIL (2025-08-08 02:43:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.851443353s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X........................X...........X........] duration: 5.771053855s FAIL (2025-08-08 02:42:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.771079203s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 639.972565ms target: https://us1.storj.io/login FAIL (2025-08-08 02:42:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 639.998654ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X........X.X.......................................] duration: 1.837764802s FAIL (2025-08-08 02:42:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.837792996s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X........................X...........X.......] duration: 5.530298208s FAIL (2025-08-08 02:41:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.530323416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 647.425123ms target: https://us1.storj.io/login FAIL (2025-08-08 02:41:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 647.455262ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X........X.X......................................] duration: 1.833131636s FAIL (2025-08-08 02:41:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 04:17.367942434 (16h24m16.957287411s) [upload=16985]: Upload finished. err: <nil> Aug 8 02:04:46.218929940 (16h24m45.808274917s) [upload=16994]: Starting upload Aug 8 02:04:46.219063255 (16h24m45.808408242s) [upload=16994]: Done starting upload Aug 8 02:04:46.219123410 (16h24m45.808468397s) [upload=16994]: Uploading segments... Aug 8 02:04:46.219227770 (16h24m45.808572757s) [upload=16994]: Got next segment. Inline: true Aug 8 02:04:46.219232629 (16h24m45.808577616s) [upload=16994]: Waiting for error group managing segments... Aug 8 02:04:46.219276662 (16h24m45.808621649s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:04:46.219281422 (16h24m45.808626409s) [upload=16994]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:04:46.219283897 (16h24m45.808628884s) [upload=16994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:04:46.487723821 (16h24m46.077068808s) [upload=16994]: Done uploading segments... Aug 8 02:04:46.487738921 (16h24m46.077083898s) [upload=16994]: Upload finished. err: <nil> Aug 8 02:06:00.146351659 (16h25m59.735696646s) [upload=17015]: Starting upload Aug 8 02:06:00.146398569 (16h25m59.735743546s) [upload=17015]: Done starting upload Aug 8 02:06:00.146441832 (16h25m59.735786819s) [upload=17015]: Uploading segments... Aug 8 02:06:00.146472220 (16h25m59.735817207s) [upload=17015]: Got next segment. Inline: true Aug 8 02:06:00.146475877 (16h25m59.735820864s) [upload=17015]: Waiting for error group managing segments... Aug 8 02:06:00.146510964 (16h25m59.735855941s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:00.146514941 (16h25m59.735859928s) [upload=17015]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:00.146517175 (16h25m59.735862152s) [upload=17015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:00.417960276 (16h26m0.007305263s) [upload=17015]: Done uploading segments... Aug 8 02:06:00.417980925 (16h26m0.007325912s) [upload=17015]: Upload finished. err: <nil> Aug 8 02:06:56.793906008 (16h26m56.383250995s) [upload=17032]: Starting upload Aug 8 02:06:56.793962846 (16h26m56.383307833s) [upload=17032]: Done starting upload Aug 8 02:06:56.794017541 (16h26m56.383362518s) [upload=17032]: Uploading segments... Aug 8 02:06:56.794044392 (16h26m56.383389379s) [upload=17032]: Got next segment. Inline: true Aug 8 02:06:56.794048681 (16h26m56.383393668s) [upload=17032]: Waiting for error group managing segments... Aug 8 02:06:56.794081374 (16h26m56.383426361s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:06:56.794085071 (16h26m56.383430058s) [upload=17032]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:06:56.794087896 (16h26m56.383432883s) [upload=17032]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:06:57.059020097 (16h26m56.648365085s) [upload=17032]: Done uploading segments... Aug 8 02:06:57.059042881 (16h26m56.648387868s) [upload=17032]: Upload finished. err: <nil> Aug 8 02:07:56.720736467 (16h27m56.310081454s) [upload=17049]: Starting upload Aug 8 02:07:56.720801021 (16h27m56.310146018s) [upload=17049]: Done starting upload Aug 8 02:07:56.720880302 (16h27m56.310225289s) [upload=17049]: Uploading segments... Aug 8 02:07:56.720923665 (16h27m56.310268652s) [upload=17049]: Got next segment. Inline: true Aug 8 02:07:56.720927683 (16h27m56.31027267s) [upload=17049]: Waiting for error group managing segments... Aug 8 02:07:56.720966768 (16h27m56.310311765s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:07:56.720971957 (16h27m56.310316944s) [upload=17049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:07:56.720974452 (16h27m56.310319439s) [upload=17049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:07:57.004624236 (16h27m56.593969223s) [upload=17049]: Done uploading segments... Aug 8 02:07:57.004643684 (16h27m56.593988671s) [upload=17049]: Upload finished. err: <nil> Aug 8 02:08:43.463079220 (16h28m43.052424207s) [upload=17060]: Starting upload Aug 8 02:08:43.463124757 (16h28m43.052469744s) [upload=17060]: Done starting upload Aug 8 02:08:43.463173941 (16h28m43.052518918s) [upload=17060]: Uploading segments... Aug 8 02:08:43.463220230 (16h28m43.052565217s) [upload=17060]: Got next segment. Inline: true Aug 8 02:08:43.463223676 (16h28m43.052568663s) [upload=17060]: Waiting for error group managing segments... Aug 8 02:08:43.463257160 (16h28m43.052602147s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:08:43.463260817 (16h28m43.052605804s) [upload=17060]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:08:43.463263012 (16h28m43.052607999s) [upload=17060]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:08:43.749484457 (16h28m43.338829444s) [upload=17060]: Done uploading segments... Aug 8 02:08:43.749501609 (16h28m43.338846596s) [upload=17060]: Upload finished. err: <nil> Aug 8 02:09:35.416097597 (16h29m35.005442584s) [upload=17077]: Starting upload Aug 8 02:09:35.416148525 (16h29m35.005493512s) [upload=17077]: Done starting upload Aug 8 02:09:35.416192759 (16h29m35.005537746s) [upload=17077]: Uploading segments... Aug 8 02:09:35.416223838 (16h29m35.005568825s) [upload=17077]: Got next segment. Inline: true Aug 8 02:09:35.416227967 (16h29m35.005572954s) [upload=17077]: Waiting for error group managing segments... Aug 8 02:09:35.416272161 (16h29m35.005617148s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:09:35.416275928 (16h29m35.005620915s) [upload=17077]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:09:35.416278122 (16h29m35.005623109s) [upload=17077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:09:35.692659360 (16h29m35.282004347s) [upload=17077]: Done uploading segments... Aug 8 02:09:35.692678066 (16h29m35.282023053s) [upload=17077]: Upload finished. err: <nil> Aug 8 02:10:15.608776167 (16h30m15.198121154s) [upload=17089]: Starting upload Aug 8 02:10:15.608826333 (16h30m15.19817132s) [upload=17089]: Done starting upload Aug 8 02:10:15.608878031 (16h30m15.198223018s) [upload=17089]: Uploading segments... Aug 8 02:10:15.608913630 (16h30m15.198258617s) [upload=17089]: Got next segment. Inline: true Aug 8 02:10:15.608918990 (16h30m15.198263977s) [upload=17089]: Waiting for error group managing segments... Aug 8 02:10:15.608968224 (16h30m15.198313212s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:10:15.608976189 (16h30m15.198321176s) [upload=17089]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:10:15.608980287 (16h30m15.198325304s) [upload=17089]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:10:15.883165694 (16h30m15.472510681s) [upload=17089]: Done uploading segments... Aug 8 02:10:15.883187786 (16h30m15.472532773s) [upload=17089]: Upload finished. err: <nil> Aug 8 02:11:14.603286683 (16h31m14.19263168s) [upload=17104]: Starting upload Aug 8 02:11:14.603349243 (16h31m14.19269423s) [upload=17104]: Done starting upload Aug 8 02:11:14.603407955 (16h31m14.192752962s) [upload=17104]: Uploading segments... Aug 8 02:11:14.603447641 (16h31m14.192792628s) [upload=17104]: Got next segment. Inline: true Aug 8 02:11:14.603453202 (16h31m14.192798199s) [upload=17104]: Waiting for error group managing segments... Aug 8 02:11:14.603498339 (16h31m14.192843336s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:11:14.603503839 (16h31m14.192848846s) [upload=17104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:11:14.603507486 (16h31m14.192852483s) [upload=17104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:11:14.868359615 (16h31m14.457704592s) [upload=17104]: Done uploading segments... Aug 8 02:11:14.868377249 (16h31m14.457722236s) [upload=17104]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:12:22.116547172 (16h32m21.705892159s) [upload=17120]: Starting upload Aug 8 02:12:22.116614582 (16h32m21.705959569s) [upload=17120]: Done starting upload Aug 8 02:12:22.116660158 (16h32m21.706005145s) [upload=17120]: Uploading segments... Aug 8 02:12:22.116691769 (16h32m21.706036756s) [upload=17120]: Got next segment. Inline: true Aug 8 02:12:22.116695176 (16h32m21.706040153s) [upload=17120]: Waiting for error group managing segments... Aug 8 02:12:22.116728850 (16h32m21.706073837s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:12:22.116732778 (16h32m21.706077765s) [upload=17120]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:12:22.116735162 (16h32m21.706080149s) [upload=17120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:12:22.411138731 (16h32m22.000483718s) [upload=17120]: Done uploading segments... Aug 8 02:12:22.411157598 (16h32m22.000502635s) [upload=17120]: Upload finished. err: <nil> Aug 8 02:13:15.678787831 (16h33m15.268132818s) [upload=17136]: Starting upload Aug 8 02:13:15.678832146 (16h33m15.268177133s) [upload=17136]: Done starting upload Aug 8 02:13:15.678885218 (16h33m15.268230205s) [upload=17136]: Uploading segments... Aug 8 02:13:15.678911258 (16h33m15.268256245s) [upload=17136]: Got next segment. Inline: true Aug 8 02:13:15.678915516 (16h33m15.268260503s) [upload=17136]: Waiting for error group managing segments... Aug 8 02:13:15.678954741 (16h33m15.268299728s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:13:15.678960382 (16h33m15.268305419s) [upload=17136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:13:15.678965241 (16h33m15.268310228s) [upload=17136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:13:16.066226156 (16h33m15.655571143s) [upload=17136]: Done uploading segments... Aug 8 02:13:16.066244290 (16h33m15.655589277s) [upload=17136]: Upload finished. err: <nil> Duration: 1.833160301s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 650.956039ms target: https://us1.storj.io/login FAIL (2025-08-08 02:41:35 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 650.987069ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)