Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X................X.................] duration: 1.837971184s FAIL (2025-08-07 14:18:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.837996853s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.........................X......XX......................] duration: 6.030881878s FAIL (2025-08-07 14:18:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.030923177s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X................X................] duration: 2.004735308s FAIL (2025-08-07 14:18:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 2.004768851s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.........................X......XX.....................] duration: 5.840147837s FAIL (2025-08-07 14:18:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.840172803s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X................X...............] duration: 1.866439191s FAIL (2025-08-07 14:17:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.866470631s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.........................X......XX....................] duration: 5.855065146s FAIL (2025-08-07 14:17:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.85509287s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X................X..............] duration: 1.884633701s FAIL (2025-08-07 14:17:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.884657708s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.........................X......XX...................] duration: 6.066034907s FAIL (2025-08-07 14:16:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.066066969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X................X.............] duration: 1.84802488s FAIL (2025-08-07 14:16:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.848047573s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........................X......XX..................] duration: 6.973660603s FAIL (2025-08-07 14:16:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.973685339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X................X............] duration: 1.850996193s FAIL (2025-08-07 14:15:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.851027544s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.832945034s FAIL (2025-08-07 14:15:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.832964953s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.........................X......XX.................] duration: 5.729151348s FAIL (2025-08-07 14:15:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.72917825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X................X...........] duration: 2.255105744s FAIL (2025-08-07 14:15:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 2.255128217s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.........................X......XX................] duration: 5.702929169s FAIL (2025-08-07 14:14:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.702951631s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X................X..........] duration: 1.851068742s FAIL (2025-08-07 14:14:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.851094912s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.699365814s FAIL (2025-08-07 14:14:36 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.699390502s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X................X.........] duration: 2.257540261s FAIL (2025-08-07 14:13:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 2.257559669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........................X......XX...............] duration: 6.112523843s FAIL (2025-08-07 14:13:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.112552017s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X................X........] duration: 1.899937102s FAIL (2025-08-07 14:13:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.89996776s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.........................X......XX..............] duration: 5.925439373s FAIL (2025-08-07 14:13:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.925461547s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.846556117s FAIL (2025-08-07 14:13:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.846581846s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.........................X......XX.............] duration: 5.766027676s FAIL (2025-08-07 14:13:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.766052634s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.875396604s FAIL (2025-08-07 14:12:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.875415942s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X................X.......] duration: 1.835304893s FAIL (2025-08-07 14:12:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.835328259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.........................X......XX............] duration: 5.689584017s FAIL (2025-08-07 14:12:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.689605748s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X................X......] duration: 1.936783317s FAIL (2025-08-07 14:11:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.936809959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.629213237s FAIL (2025-08-07 14:11:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.629239458s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.877044507s FAIL (2025-08-07 14:11:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.877069955s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........................X......XX...........] duration: 5.839912223s FAIL (2025-08-07 14:11:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.839936831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration: 1.948442103s FAIL (2025-08-07 14:10:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.948468884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.659531267s FAIL (2025-08-07 14:10:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.659556064s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........................X......XX..........] duration: 5.863532558s FAIL (2025-08-07 14:10:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.863561464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X................X....] duration: 1.871083007s FAIL (2025-08-07 14:10:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.871111341s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.689681012s FAIL (2025-08-07 14:10:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.6897062s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X................X...] duration: 1.981024142s FAIL (2025-08-07 14:09:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.98104383s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X................X..] duration: 1.885211979s FAIL (2025-08-07 14:09:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.885249721s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.........................X......XX.........] duration: 6.023849259s FAIL (2025-08-07 14:09:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.023878935s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.750937506s FAIL (2025-08-07 14:09:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.750966903s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X................X.] duration: 1.862047972s FAIL (2025-08-07 14:09:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.862075004s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.........................X......XX........] duration: 5.889559917s FAIL (2025-08-07 14:08:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.8895829s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.035147181s FAIL (2025-08-07 14:08:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.035173912s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X................X] duration: 1.61773847s FAIL (2025-08-07 14:08:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== atch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:00:48.037551949 (4h20m47.626896946s) [upload=4541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:00:48.378575813 (4h20m47.9679208s) [upload=4541]: Done uploading segments... Aug 7 14:00:48.378594528 (4h20m47.967939515s) [upload=4541]: Upload finished. err: <nil> Aug 7 14:01:35.035211571 (4h21m34.624556558s) [upload=4557]: Starting upload Aug 7 14:01:35.035273790 (4h21m34.624618777s) [upload=4557]: Done starting upload Aug 7 14:01:35.035343794 (4h21m34.624688781s) [upload=4557]: Uploading segments... Aug 7 14:01:35.035416753 (4h21m34.62476174s) [upload=4557]: Got next segment. Inline: true Aug 7 14:01:35.035421432 (4h21m34.624766409s) [upload=4557]: Waiting for error group managing segments... Aug 7 14:01:35.035459064 (4h21m34.624804051s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:35.035463122 (4h21m34.624808109s) [upload=4557]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:01:35.035465476 (4h21m34.624810454s) [upload=4557]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:35.540236422 (4h21m35.129581409s) [upload=4557]: Done uploading segments... Aug 7 14:01:35.540253455 (4h21m35.129598442s) [upload=4557]: Upload finished. err: <nil> Aug 7 14:02:48.999704813 (4h22m48.5890498s) [upload=4574]: Starting upload Aug 7 14:02:48.999754418 (4h22m48.589099405s) [upload=4574]: Done starting upload Aug 7 14:02:48.999799184 (4h22m48.589144161s) [upload=4574]: Uploading segments... Aug 7 14:02:48.999848198 (4h22m48.589193175s) [upload=4574]: Got next segment. Inline: true Aug 7 14:02:48.999852646 (4h22m48.589197633s) [upload=4574]: Waiting for error group managing segments... Aug 7 14:02:48.999890588 (4h22m48.589235575s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:02:48.999895347 (4h22m48.589240324s) [upload=4574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:02:48.999897611 (4h22m48.589242598s) [upload=4574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:02:49.290012712 (4h22m48.879357709s) [upload=4574]: Done uploading segments... Aug 7 14:02:49.290031077 (4h22m48.879376074s) [upload=4574]: Upload finished. err: <nil> Aug 7 14:03:12.553185285 (4h23m12.142530272s) [upload=4582]: Starting upload Aug 7 14:03:12.553280016 (4h23m12.142625003s) [upload=4582]: Done starting upload Aug 7 14:03:12.553342956 (4h23m12.142687943s) [upload=4582]: Uploading segments... Aug 7 14:03:12.553382813 (4h23m12.14272781s) [upload=4582]: Got next segment. Inline: true Aug 7 14:03:12.553387722 (4h23m12.142732709s) [upload=4582]: Waiting for error group managing segments... Aug 7 14:03:12.553428691 (4h23m12.142773678s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:03:12.553433009 (4h23m12.142777996s) [upload=4582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:03:12.553436145 (4h23m12.142781132s) [upload=4582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:03:12.814363911 (4h23m12.403708898s) [upload=4582]: Done uploading segments... Aug 7 14:03:12.814428204 (4h23m12.403773191s) [upload=4582]: Upload finished. err: <nil> Aug 7 14:04:06.516287549 (4h24m6.105632526s) [upload=4599]: Starting upload Aug 7 14:04:06.516330451 (4h24m6.105675428s) [upload=4599]: Done starting upload Aug 7 14:04:06.516380176 (4h24m6.105725153s) [upload=4599]: Uploading segments... Aug 7 14:04:06.516412237 (4h24m6.105757225s) [upload=4599]: Got next segment. Inline: true Aug 7 14:04:06.516415604 (4h24m6.105760591s) [upload=4599]: Waiting for error group managing segments... Aug 7 14:04:06.516445983 (4h24m6.10579097s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:06.516451734 (4h24m6.105796721s) [upload=4599]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:06.516454409 (4h24m6.105799396s) [upload=4599]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:06.860979407 (4h24m6.450324425s) [upload=4599]: Done uploading segments... Aug 7 14:04:06.861008313 (4h24m6.45035334s) [upload=4599]: Upload finished. err: <nil> Aug 7 14:04:46.205958111 (4h24m45.795303098s) [upload=4611]: Starting upload Aug 7 14:04:46.206016493 (4h24m45.79536148s) [upload=4611]: Done starting upload Aug 7 14:04:46.206062561 (4h24m45.795407548s) [upload=4611]: Uploading segments... Aug 7 14:04:46.206090064 (4h24m45.795435051s) [upload=4611]: Got next segment. Inline: true Aug 7 14:04:46.206093741 (4h24m45.795438718s) [upload=4611]: Waiting for error group managing segments... Aug 7 14:04:46.206125541 (4h24m45.795470529s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:04:46.206129078 (4h24m45.795474065s) [upload=4611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:04:46.206131332 (4h24m45.795476319s) [upload=4611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:04:46.481667519 (4h24m46.071012516s) [upload=4611]: Done uploading segments... Aug 7 14:04:46.481687357 (4h24m46.071032364s) [upload=4611]: Upload finished. err: <nil> Aug 7 14:05:45.402643472 (4h25m44.991988459s) [upload=4628]: Starting upload Aug 7 14:05:45.402700772 (4h25m44.992045749s) [upload=4628]: Done starting upload Aug 7 14:05:45.402749535 (4h25m44.992094522s) [upload=4628]: Uploading segments... Aug 7 14:05:45.402778460 (4h25m44.992123447s) [upload=4628]: Got next segment. Inline: true Aug 7 14:05:45.402782187 (4h25m44.992127174s) [upload=4628]: Waiting for error group managing segments... Aug 7 14:05:45.402814238 (4h25m44.992159226s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:05:45.402817915 (4h25m44.992162902s) [upload=4628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:05:45.402820460 (4h25m44.992165447s) [upload=4628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:05:45.702644426 (4h25m45.291989413s) [upload=4628]: Done uploading segments... Aug 7 14:05:45.702662270 (4h25m45.292007257s) [upload=4628]: Upload finished. err: <nil> Aug 7 14:06:31.513308302 (4h26m31.102653289s) [upload=4642]: Starting upload Aug 7 14:06:31.513355894 (4h26m31.102700881s) [upload=4642]: Done starting upload Aug 7 14:06:31.513451307 (4h26m31.102796304s) [upload=4642]: Uploading segments... Aug 7 14:06:31.513524837 (4h26m31.102869914s) [upload=4642]: Got next segment. Inline: true Aug 7 14:06:31.513534396 (4h26m31.102879463s) [upload=4642]: Waiting for error group managing segments... Aug 7 14:06:31.513595011 (4h26m31.102940019s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:06:31.513601804 (4h26m31.102946821s) [upload=4642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:06:31.513606082 (4h26m31.102951069s) [upload=4642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:06:31.792470896 (4h26m31.381815873s) [upload=4642]: Done uploading segments... Aug 7 14:06:31.792487428 (4h26m31.381832415s) [upload=4642]: Upload finished. err: <nil> Aug 7 14:07:03.143647805 (4h27m2.732992792s) [upload=4653]: Starting upload Aug 7 14:07:03.143761353 (4h27m2.73310634s) [upload=4653]: Done starting upload Aug 7 14:07:03.143833891 (4h27m2.733178898s) [upload=4653]: Uploading segments... Aug 7 14:07:03.143874369 (4h27m2.733219406s) [upload=4653]: Got next segment. Inline: true Aug 7 14:07:03.143879739 (4h27m2.733224726s) [upload=4653]: Waiting for error group managing segments... Aug 7 14:07:03.143926629 (4h27m2.733271616s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:03.143931578 (4h27m2.733276566s) [upload=4653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:03.143935416 (4h27m2.733280403s) [upload=4653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:03.438314793 (4h27m3.02765979s) [upload=4653]: Done uploading segments... Aug 7 14:07:03.438335052 (4h27m3.027680039s) [upload=4653]: Upload finished. err: <nil> Aug 7 14:07:30.317503110 (4h27m29.906848108s) [upload=4661]: Starting upload Aug 7 14:07:30.317553848 (4h27m29.906898835s) [upload=4661]: Done starting upload Aug 7 14:07:30.317628611 (4h27m29.906973598s) [upload=4661]: Uploading segments... Aug 7 14:07:30.317665121 (4h27m29.907010118s) [upload=4661]: Got next segment. Inline: true Aug 7 14:07:30.317671012 (4h27m29.907016009s) [upload=4661]: Waiting for error group managing segments... Aug 7 14:07:30.317731507 (4h27m29.907076484s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:07:30.317736748 (4h27m29.907081735s) [upload=4661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:07:30.317739543 (4h27m29.90708452s) [upload=4661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:07:30.758835618 (4h27m30.348180595s) [upload=4661]: Done uploading segments... Aug 7 14:07:30.758855156 (4h27m30.348200143s) [upload=4661]: Upload finished. err: <nil> Aug 7 14:08:00.622329664 (4h28m0.211674651s) [upload=4669]: Starting upload Aug 7 14:08:00.622386723 (4h28m0.211731711s) [upload=4669]: Done starting upload Aug 7 14:08:00.622442731 (4h28m0.211787718s) [upload=4669]: Uploading segments... Aug 7 14:08:00.622478138 (4h28m0.211823125s) [upload=4669]: Got next segment. Inline: true Aug 7 14:08:00.622482506 (4h28m0.211827493s) [upload=4669]: Waiting for error group managing segments... Aug 7 14:08:00.622556518 (4h28m0.211901505s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:08:00.622561568 (4h28m0.211906555s) [upload=4669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 14:08:00.622564503 (4h28m0.21190949s) [upload=4669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:08:00.931695465 (4h28m0.521040452s) [upload=4669]: Done uploading segments... Aug 7 14:08:00.931714752 (4h28m0.521059729s) [upload=4669]: Upload finished. err: <nil> Duration: 1.617770723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.835001617s FAIL (2025-08-07 14:07:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.835026625s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.........................X......XX.......] duration: 5.649985905s FAIL (2025-08-07 14:07:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 5.650009952s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.027998197s FAIL (2025-08-07 14:07:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:15.162718610 (4h8m14.752063587s) [upload=4331]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:48:15.894155246 (4h8m15.483500233s) [upload=4331]: Done uploading segments... Aug 7 13:48:15.894172539 (4h8m15.483517526s) [upload=4331]: Upload finished. err: <nil> Aug 7 13:49:23.904055619 (4h9m23.493400596s) [upload=4348]: Starting upload Aug 7 13:49:23.904094805 (4h9m23.493439792s) [upload=4348]: Done starting upload Aug 7 13:49:23.904150271 (4h9m23.493495258s) [upload=4348]: Uploading segments... Aug 7 13:49:23.904183995 (4h9m23.493528982s) [upload=4348]: Got next segment. Inline: true Aug 7 13:49:23.904187742 (4h9m23.493532729s) [upload=4348]: Waiting for error group managing segments... Aug 7 13:49:23.904233570 (4h9m23.493578597s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:23.904240233 (4h9m23.49358522s) [upload=4348]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:23.904242828 (4h9m23.493587815s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:24.191927938 (4h9m23.781272925s) [upload=4348]: Done uploading segments... Aug 7 13:49:24.191947214 (4h9m23.781292201s) [upload=4348]: Upload finished. err: <nil> Aug 7 13:49:41.320452088 (4h9m40.909797075s) [upload=4352]: Starting upload Aug 7 13:49:41.320497054 (4h9m40.909842041s) [upload=4352]: Done starting upload Aug 7 13:49:41.320543232 (4h9m40.909888219s) [upload=4352]: Uploading segments... Aug 7 13:49:41.320573390 (4h9m40.909918377s) [upload=4352]: Got next segment. Inline: true Aug 7 13:49:41.320577177 (4h9m40.909922164s) [upload=4352]: Waiting for error group managing segments... Aug 7 13:49:41.320609029 (4h9m40.909954016s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:41.320612876 (4h9m40.909957863s) [upload=4352]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:41.320615441 (4h9m40.909960428s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:41.608558223 (4h9m41.19790321s) [upload=4352]: Done uploading segments... Aug 7 13:49:41.608576398 (4h9m41.197921385s) [upload=4352]: Upload finished. err: <nil> Aug 7 13:50:55.115493599 (4h10m54.704838586s) [upload=4373]: Starting upload Aug 7 13:50:55.115578362 (4h10m54.704923349s) [upload=4373]: Done starting upload Aug 7 13:50:55.115836275 (4h10m54.705181262s) [upload=4373]: Uploading segments... Aug 7 13:50:55.115944111 (4h10m54.705289128s) [upload=4373]: Got next segment. Inline: true Aug 7 13:50:55.115952958 (4h10m54.705297995s) [upload=4373]: Waiting for error group managing segments... Aug 7 13:50:55.115995700 (4h10m54.705340687s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:50:55.115999738 (4h10m54.705344715s) [upload=4373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:55.116004006 (4h10m54.705348983s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:50:55.640199205 (4h10m55.229544192s) [upload=4373]: Done uploading segments... Aug 7 13:50:55.640221969 (4h10m55.229566966s) [upload=4373]: Upload finished. err: <nil> Aug 7 13:51:52.372594179 (4h11m51.961939166s) [upload=4392]: Starting upload Aug 7 13:51:52.372651779 (4h11m51.961996766s) [upload=4392]: Done starting upload Aug 7 13:51:52.372707015 (4h11m51.962052002s) [upload=4392]: Uploading segments... Aug 7 13:51:52.372748114 (4h11m51.962093101s) [upload=4392]: Got next segment. Inline: true Aug 7 13:51:52.372753213 (4h11m51.962098201s) [upload=4392]: Waiting for error group managing segments... Aug 7 13:51:52.372785014 (4h11m51.962130001s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:51:52.372789042 (4h11m51.962134029s) [upload=4392]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:51:52.372791216 (4h11m51.962136193s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:51:52.651845393 (4h11m52.24119038s) [upload=4392]: Done uploading segments... Aug 7 13:51:52.651866815 (4h11m52.241211802s) [upload=4392]: Upload finished. err: <nil> Aug 7 13:52:31.144886892 (4h12m30.734231879s) [upload=4400]: Starting upload Aug 7 13:52:31.144947699 (4h12m30.734292686s) [upload=4400]: Done starting upload Aug 7 13:52:31.145030747 (4h12m30.734375734s) [upload=4400]: Uploading segments... Aug 7 13:52:31.145076044 (4h12m30.734421032s) [upload=4400]: Got next segment. Inline: true Aug 7 13:52:31.145079832 (4h12m30.734424809s) [upload=4400]: Waiting for error group managing segments... Aug 7 13:52:31.145118105 (4h12m30.734463092s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:52:31.145133514 (4h12m30.734478501s) [upload=4400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:52:31.145136139 (4h12m30.734481116s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:52:31.431169519 (4h12m31.020514506s) [upload=4400]: Done uploading segments... Aug 7 13:52:31.431188195 (4h12m31.020533182s) [upload=4400]: Upload finished. err: <nil> Aug 7 13:53:08.777110543 (4h13m8.36645557s) [upload=4411]: Starting upload Aug 7 13:53:08.777204873 (4h13m8.36654989s) [upload=4411]: Done starting upload Aug 7 13:53:08.777292812 (4h13m8.366637799s) [upload=4411]: Uploading segments... Aug 7 13:53:08.777343308 (4h13m8.366688336s) [upload=4411]: Got next segment. Inline: true Aug 7 13:53:08.777350722 (4h13m8.36669578s) [upload=4411]: Waiting for error group managing segments... Aug 7 13:53:08.777411438 (4h13m8.366756475s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:53:08.777419303 (4h13m8.36676433s) [upload=4411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:53:08.777425184 (4h13m8.366770201s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:53:09.061090294 (4h13m8.650435281s) [upload=4411]: Done uploading segments... Aug 7 13:53:09.061107496 (4h13m8.650452473s) [upload=4411]: Upload finished. err: <nil> Aug 7 13:54:13.127652051 (4h14m12.716997038s) [upload=4427]: Starting upload Aug 7 13:54:13.127716403 (4h14m12.71706138s) [upload=4427]: Done starting upload Aug 7 13:54:13.127800033 (4h14m12.71714501s) [upload=4427]: Uploading segments... Aug 7 13:54:13.127832376 (4h14m12.717177353s) [upload=4427]: Got next segment. Inline: true Aug 7 13:54:13.127836434 (4h14m12.717181421s) [upload=4427]: Waiting for error group managing segments... Aug 7 13:54:13.127894114 (4h14m12.717239101s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:13.127898973 (4h14m12.71724396s) [upload=4427]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:13.127903532 (4h14m12.717248549s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:13.463972574 (4h14m13.053317561s) [upload=4427]: Done uploading segments... Aug 7 13:54:13.463987873 (4h14m13.05333286s) [upload=4427]: Upload finished. err: <nil> Aug 7 13:54:50.834737674 (4h14m50.424082662s) [upload=4439]: Starting upload Aug 7 13:54:50.834787840 (4h14m50.424132827s) [upload=4439]: Done starting upload Aug 7 13:54:50.834966452 (4h14m50.424311439s) [upload=4439]: Uploading segments... Aug 7 13:54:50.834996349 (4h14m50.424341336s) [upload=4439]: Got next segment. Inline: true Aug 7 13:54:50.835000357 (4h14m50.424345344s) [upload=4439]: Waiting for error group managing segments... Aug 7 13:54:50.835031085 (4h14m50.424376072s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:50.835034802 (4h14m50.424379789s) [upload=4439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:50.835037347 (4h14m50.424382324s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:51.236764008 (4h14m50.826108995s) [upload=4439]: Done uploading segments... Aug 7 13:54:51.236781783 (4h14m50.82612677s) [upload=4439]: Upload finished. err: <nil> Aug 7 13:55:12.852977367 (4h15m12.442322354s) [upload=4449]: Starting upload Aug 7 13:55:12.853067630 (4h15m12.442412617s) [upload=4449]: Done starting upload Aug 7 13:55:12.853125801 (4h15m12.442470788s) [upload=4449]: Uploading segments... Aug 7 13:55:12.853158114 (4h15m12.442503101s) [upload=4449]: Got next segment. Inline: true Aug 7 13:55:12.853162542 (4h15m12.442507519s) [upload=4449]: Waiting for error group managing segments... Aug 7 13:55:12.853197559 (4h15m12.442542536s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:12.853205774 (4h15m12.442550751s) [upload=4449]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:12.853208359 (4h15m12.442553346s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:13.125412310 (4h15m12.714757297s) [upload=4449]: Done uploading segments... Aug 7 13:55:13.125437198 (4h15m12.714782195s) [upload=4449]: Upload finished. err: <nil> Aug 7 13:55:47.628821506 (4h15m47.218166493s) [upload=4457]: Starting upload Aug 7 13:55:47.628864678 (4h15m47.218209655s) [upload=4457]: Done starting upload Aug 7 13:55:47.628934532 (4h15m47.218279519s) [upload=4457]: Uploading segments... Aug 7 13:55:47.628978316 (4h15m47.218323293s) [upload=4457]: Got next segment. Inline: true Aug 7 13:55:47.628993244 (4h15m47.218338231s) [upload=4457]: Waiting for error group managing segments... Aug 7 13:55:47.629028732 (4h15m47.218373719s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:47.629034243 (4h15m47.21837923s) [upload=4457]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:47.629036588 (4h15m47.218381575s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:47.927925053 (4h15m47.51727004s) [upload=4457]: Done uploading segments... Aug 7 13:55:47.927945021 (4h15m47.517290008s) [upload=4457]: Upload finished. err: <nil> Duration: 2.028030378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.84825547s FAIL (2025-08-07 14:07:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:15.162718610 (4h8m14.752063587s) [upload=4331]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:48:15.894155246 (4h8m15.483500233s) [upload=4331]: Done uploading segments... Aug 7 13:48:15.894172539 (4h8m15.483517526s) [upload=4331]: Upload finished. err: <nil> Aug 7 13:49:23.904055619 (4h9m23.493400596s) [upload=4348]: Starting upload Aug 7 13:49:23.904094805 (4h9m23.493439792s) [upload=4348]: Done starting upload Aug 7 13:49:23.904150271 (4h9m23.493495258s) [upload=4348]: Uploading segments... Aug 7 13:49:23.904183995 (4h9m23.493528982s) [upload=4348]: Got next segment. Inline: true Aug 7 13:49:23.904187742 (4h9m23.493532729s) [upload=4348]: Waiting for error group managing segments... Aug 7 13:49:23.904233570 (4h9m23.493578597s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:23.904240233 (4h9m23.49358522s) [upload=4348]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:23.904242828 (4h9m23.493587815s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:24.191927938 (4h9m23.781272925s) [upload=4348]: Done uploading segments... Aug 7 13:49:24.191947214 (4h9m23.781292201s) [upload=4348]: Upload finished. err: <nil> Aug 7 13:49:41.320452088 (4h9m40.909797075s) [upload=4352]: Starting upload Aug 7 13:49:41.320497054 (4h9m40.909842041s) [upload=4352]: Done starting upload Aug 7 13:49:41.320543232 (4h9m40.909888219s) [upload=4352]: Uploading segments... Aug 7 13:49:41.320573390 (4h9m40.909918377s) [upload=4352]: Got next segment. Inline: true Aug 7 13:49:41.320577177 (4h9m40.909922164s) [upload=4352]: Waiting for error group managing segments... Aug 7 13:49:41.320609029 (4h9m40.909954016s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:41.320612876 (4h9m40.909957863s) [upload=4352]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:41.320615441 (4h9m40.909960428s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:41.608558223 (4h9m41.19790321s) [upload=4352]: Done uploading segments... Aug 7 13:49:41.608576398 (4h9m41.197921385s) [upload=4352]: Upload finished. err: <nil> Aug 7 13:50:55.115493599 (4h10m54.704838586s) [upload=4373]: Starting upload Aug 7 13:50:55.115578362 (4h10m54.704923349s) [upload=4373]: Done starting upload Aug 7 13:50:55.115836275 (4h10m54.705181262s) [upload=4373]: Uploading segments... Aug 7 13:50:55.115944111 (4h10m54.705289128s) [upload=4373]: Got next segment. Inline: true Aug 7 13:50:55.115952958 (4h10m54.705297995s) [upload=4373]: Waiting for error group managing segments... Aug 7 13:50:55.115995700 (4h10m54.705340687s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:50:55.115999738 (4h10m54.705344715s) [upload=4373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:55.116004006 (4h10m54.705348983s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:50:55.640199205 (4h10m55.229544192s) [upload=4373]: Done uploading segments... Aug 7 13:50:55.640221969 (4h10m55.229566966s) [upload=4373]: Upload finished. err: <nil> Aug 7 13:51:52.372594179 (4h11m51.961939166s) [upload=4392]: Starting upload Aug 7 13:51:52.372651779 (4h11m51.961996766s) [upload=4392]: Done starting upload Aug 7 13:51:52.372707015 (4h11m51.962052002s) [upload=4392]: Uploading segments... Aug 7 13:51:52.372748114 (4h11m51.962093101s) [upload=4392]: Got next segment. Inline: true Aug 7 13:51:52.372753213 (4h11m51.962098201s) [upload=4392]: Waiting for error group managing segments... Aug 7 13:51:52.372785014 (4h11m51.962130001s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:51:52.372789042 (4h11m51.962134029s) [upload=4392]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:51:52.372791216 (4h11m51.962136193s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:51:52.651845393 (4h11m52.24119038s) [upload=4392]: Done uploading segments... Aug 7 13:51:52.651866815 (4h11m52.241211802s) [upload=4392]: Upload finished. err: <nil> Aug 7 13:52:31.144886892 (4h12m30.734231879s) [upload=4400]: Starting upload Aug 7 13:52:31.144947699 (4h12m30.734292686s) [upload=4400]: Done starting upload Aug 7 13:52:31.145030747 (4h12m30.734375734s) [upload=4400]: Uploading segments... Aug 7 13:52:31.145076044 (4h12m30.734421032s) [upload=4400]: Got next segment. Inline: true Aug 7 13:52:31.145079832 (4h12m30.734424809s) [upload=4400]: Waiting for error group managing segments... Aug 7 13:52:31.145118105 (4h12m30.734463092s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:52:31.145133514 (4h12m30.734478501s) [upload=4400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:52:31.145136139 (4h12m30.734481116s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:52:31.431169519 (4h12m31.020514506s) [upload=4400]: Done uploading segments... Aug 7 13:52:31.431188195 (4h12m31.020533182s) [upload=4400]: Upload finished. err: <nil> Aug 7 13:53:08.777110543 (4h13m8.36645557s) [upload=4411]: Starting upload Aug 7 13:53:08.777204873 (4h13m8.36654989s) [upload=4411]: Done starting upload Aug 7 13:53:08.777292812 (4h13m8.366637799s) [upload=4411]: Uploading segments... Aug 7 13:53:08.777343308 (4h13m8.366688336s) [upload=4411]: Got next segment. Inline: true Aug 7 13:53:08.777350722 (4h13m8.36669578s) [upload=4411]: Waiting for error group managing segments... Aug 7 13:53:08.777411438 (4h13m8.366756475s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:53:08.777419303 (4h13m8.36676433s) [upload=4411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:53:08.777425184 (4h13m8.366770201s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:53:09.061090294 (4h13m8.650435281s) [upload=4411]: Done uploading segments... Aug 7 13:53:09.061107496 (4h13m8.650452473s) [upload=4411]: Upload finished. err: <nil> Aug 7 13:54:13.127652051 (4h14m12.716997038s) [upload=4427]: Starting upload Aug 7 13:54:13.127716403 (4h14m12.71706138s) [upload=4427]: Done starting upload Aug 7 13:54:13.127800033 (4h14m12.71714501s) [upload=4427]: Uploading segments... Aug 7 13:54:13.127832376 (4h14m12.717177353s) [upload=4427]: Got next segment. Inline: true Aug 7 13:54:13.127836434 (4h14m12.717181421s) [upload=4427]: Waiting for error group managing segments... Aug 7 13:54:13.127894114 (4h14m12.717239101s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:13.127898973 (4h14m12.71724396s) [upload=4427]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:13.127903532 (4h14m12.717248549s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:13.463972574 (4h14m13.053317561s) [upload=4427]: Done uploading segments... Aug 7 13:54:13.463987873 (4h14m13.05333286s) [upload=4427]: Upload finished. err: <nil> Aug 7 13:54:50.834737674 (4h14m50.424082662s) [upload=4439]: Starting upload Aug 7 13:54:50.834787840 (4h14m50.424132827s) [upload=4439]: Done starting upload Aug 7 13:54:50.834966452 (4h14m50.424311439s) [upload=4439]: Uploading segments... Aug 7 13:54:50.834996349 (4h14m50.424341336s) [upload=4439]: Got next segment. Inline: true Aug 7 13:54:50.835000357 (4h14m50.424345344s) [upload=4439]: Waiting for error group managing segments... Aug 7 13:54:50.835031085 (4h14m50.424376072s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:50.835034802 (4h14m50.424379789s) [upload=4439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:50.835037347 (4h14m50.424382324s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:51.236764008 (4h14m50.826108995s) [upload=4439]: Done uploading segments... Aug 7 13:54:51.236781783 (4h14m50.82612677s) [upload=4439]: Upload finished. err: <nil> Aug 7 13:55:12.852977367 (4h15m12.442322354s) [upload=4449]: Starting upload Aug 7 13:55:12.853067630 (4h15m12.442412617s) [upload=4449]: Done starting upload Aug 7 13:55:12.853125801 (4h15m12.442470788s) [upload=4449]: Uploading segments... Aug 7 13:55:12.853158114 (4h15m12.442503101s) [upload=4449]: Got next segment. Inline: true Aug 7 13:55:12.853162542 (4h15m12.442507519s) [upload=4449]: Waiting for error group managing segments... Aug 7 13:55:12.853197559 (4h15m12.442542536s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:12.853205774 (4h15m12.442550751s) [upload=4449]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:12.853208359 (4h15m12.442553346s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:13.125412310 (4h15m12.714757297s) [upload=4449]: Done uploading segments... Aug 7 13:55:13.125437198 (4h15m12.714782195s) [upload=4449]: Upload finished. err: <nil> Aug 7 13:55:47.628821506 (4h15m47.218166493s) [upload=4457]: Starting upload Aug 7 13:55:47.628864678 (4h15m47.218209655s) [upload=4457]: Done starting upload Aug 7 13:55:47.628934532 (4h15m47.218279519s) [upload=4457]: Uploading segments... Aug 7 13:55:47.628978316 (4h15m47.218323293s) [upload=4457]: Got next segment. Inline: true Aug 7 13:55:47.628993244 (4h15m47.218338231s) [upload=4457]: Waiting for error group managing segments... Aug 7 13:55:47.629028732 (4h15m47.218373719s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:47.629034243 (4h15m47.21837923s) [upload=4457]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:47.629036588 (4h15m47.218381575s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:47.927925053 (4h15m47.51727004s) [upload=4457]: Done uploading segments... Aug 7 13:55:47.927945021 (4h15m47.517290008s) [upload=4457]: Upload finished. err: <nil> Duration: 1.848285107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.548171969s FAIL (2025-08-07 14:06:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.548200161s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.846851243s FAIL (2025-08-07 14:06:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:48:15.162718610 (4h8m14.752063587s) [upload=4331]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:48:15.894155246 (4h8m15.483500233s) [upload=4331]: Done uploading segments... Aug 7 13:48:15.894172539 (4h8m15.483517526s) [upload=4331]: Upload finished. err: <nil> Aug 7 13:49:23.904055619 (4h9m23.493400596s) [upload=4348]: Starting upload Aug 7 13:49:23.904094805 (4h9m23.493439792s) [upload=4348]: Done starting upload Aug 7 13:49:23.904150271 (4h9m23.493495258s) [upload=4348]: Uploading segments... Aug 7 13:49:23.904183995 (4h9m23.493528982s) [upload=4348]: Got next segment. Inline: true Aug 7 13:49:23.904187742 (4h9m23.493532729s) [upload=4348]: Waiting for error group managing segments... Aug 7 13:49:23.904233570 (4h9m23.493578597s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:23.904240233 (4h9m23.49358522s) [upload=4348]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:23.904242828 (4h9m23.493587815s) [upload=4348]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:24.191927938 (4h9m23.781272925s) [upload=4348]: Done uploading segments... Aug 7 13:49:24.191947214 (4h9m23.781292201s) [upload=4348]: Upload finished. err: <nil> Aug 7 13:49:41.320452088 (4h9m40.909797075s) [upload=4352]: Starting upload Aug 7 13:49:41.320497054 (4h9m40.909842041s) [upload=4352]: Done starting upload Aug 7 13:49:41.320543232 (4h9m40.909888219s) [upload=4352]: Uploading segments... Aug 7 13:49:41.320573390 (4h9m40.909918377s) [upload=4352]: Got next segment. Inline: true Aug 7 13:49:41.320577177 (4h9m40.909922164s) [upload=4352]: Waiting for error group managing segments... Aug 7 13:49:41.320609029 (4h9m40.909954016s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:49:41.320612876 (4h9m40.909957863s) [upload=4352]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:49:41.320615441 (4h9m40.909960428s) [upload=4352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:49:41.608558223 (4h9m41.19790321s) [upload=4352]: Done uploading segments... Aug 7 13:49:41.608576398 (4h9m41.197921385s) [upload=4352]: Upload finished. err: <nil> Aug 7 13:50:55.115493599 (4h10m54.704838586s) [upload=4373]: Starting upload Aug 7 13:50:55.115578362 (4h10m54.704923349s) [upload=4373]: Done starting upload Aug 7 13:50:55.115836275 (4h10m54.705181262s) [upload=4373]: Uploading segments... Aug 7 13:50:55.115944111 (4h10m54.705289128s) [upload=4373]: Got next segment. Inline: true Aug 7 13:50:55.115952958 (4h10m54.705297995s) [upload=4373]: Waiting for error group managing segments... Aug 7 13:50:55.115995700 (4h10m54.705340687s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:50:55.115999738 (4h10m54.705344715s) [upload=4373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:50:55.116004006 (4h10m54.705348983s) [upload=4373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:50:55.640199205 (4h10m55.229544192s) [upload=4373]: Done uploading segments... Aug 7 13:50:55.640221969 (4h10m55.229566966s) [upload=4373]: Upload finished. err: <nil> Aug 7 13:51:52.372594179 (4h11m51.961939166s) [upload=4392]: Starting upload Aug 7 13:51:52.372651779 (4h11m51.961996766s) [upload=4392]: Done starting upload Aug 7 13:51:52.372707015 (4h11m51.962052002s) [upload=4392]: Uploading segments... Aug 7 13:51:52.372748114 (4h11m51.962093101s) [upload=4392]: Got next segment. Inline: true Aug 7 13:51:52.372753213 (4h11m51.962098201s) [upload=4392]: Waiting for error group managing segments... Aug 7 13:51:52.372785014 (4h11m51.962130001s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:51:52.372789042 (4h11m51.962134029s) [upload=4392]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:51:52.372791216 (4h11m51.962136193s) [upload=4392]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:51:52.651845393 (4h11m52.24119038s) [upload=4392]: Done uploading segments... Aug 7 13:51:52.651866815 (4h11m52.241211802s) [upload=4392]: Upload finished. err: <nil> Aug 7 13:52:31.144886892 (4h12m30.734231879s) [upload=4400]: Starting upload Aug 7 13:52:31.144947699 (4h12m30.734292686s) [upload=4400]: Done starting upload Aug 7 13:52:31.145030747 (4h12m30.734375734s) [upload=4400]: Uploading segments... Aug 7 13:52:31.145076044 (4h12m30.734421032s) [upload=4400]: Got next segment. Inline: true Aug 7 13:52:31.145079832 (4h12m30.734424809s) [upload=4400]: Waiting for error group managing segments... Aug 7 13:52:31.145118105 (4h12m30.734463092s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:52:31.145133514 (4h12m30.734478501s) [upload=4400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:52:31.145136139 (4h12m30.734481116s) [upload=4400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:52:31.431169519 (4h12m31.020514506s) [upload=4400]: Done uploading segments... Aug 7 13:52:31.431188195 (4h12m31.020533182s) [upload=4400]: Upload finished. err: <nil> Aug 7 13:53:08.777110543 (4h13m8.36645557s) [upload=4411]: Starting upload Aug 7 13:53:08.777204873 (4h13m8.36654989s) [upload=4411]: Done starting upload Aug 7 13:53:08.777292812 (4h13m8.366637799s) [upload=4411]: Uploading segments... Aug 7 13:53:08.777343308 (4h13m8.366688336s) [upload=4411]: Got next segment. Inline: true Aug 7 13:53:08.777350722 (4h13m8.36669578s) [upload=4411]: Waiting for error group managing segments... Aug 7 13:53:08.777411438 (4h13m8.366756475s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:53:08.777419303 (4h13m8.36676433s) [upload=4411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:53:08.777425184 (4h13m8.366770201s) [upload=4411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:53:09.061090294 (4h13m8.650435281s) [upload=4411]: Done uploading segments... Aug 7 13:53:09.061107496 (4h13m8.650452473s) [upload=4411]: Upload finished. err: <nil> Aug 7 13:54:13.127652051 (4h14m12.716997038s) [upload=4427]: Starting upload Aug 7 13:54:13.127716403 (4h14m12.71706138s) [upload=4427]: Done starting upload Aug 7 13:54:13.127800033 (4h14m12.71714501s) [upload=4427]: Uploading segments... Aug 7 13:54:13.127832376 (4h14m12.717177353s) [upload=4427]: Got next segment. Inline: true Aug 7 13:54:13.127836434 (4h14m12.717181421s) [upload=4427]: Waiting for error group managing segments... Aug 7 13:54:13.127894114 (4h14m12.717239101s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:13.127898973 (4h14m12.71724396s) [upload=4427]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:13.127903532 (4h14m12.717248549s) [upload=4427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:13.463972574 (4h14m13.053317561s) [upload=4427]: Done uploading segments... Aug 7 13:54:13.463987873 (4h14m13.05333286s) [upload=4427]: Upload finished. err: <nil> Aug 7 13:54:50.834737674 (4h14m50.424082662s) [upload=4439]: Starting upload Aug 7 13:54:50.834787840 (4h14m50.424132827s) [upload=4439]: Done starting upload Aug 7 13:54:50.834966452 (4h14m50.424311439s) [upload=4439]: Uploading segments... Aug 7 13:54:50.834996349 (4h14m50.424341336s) [upload=4439]: Got next segment. Inline: true Aug 7 13:54:50.835000357 (4h14m50.424345344s) [upload=4439]: Waiting for error group managing segments... Aug 7 13:54:50.835031085 (4h14m50.424376072s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:54:50.835034802 (4h14m50.424379789s) [upload=4439]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:54:50.835037347 (4h14m50.424382324s) [upload=4439]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:54:51.236764008 (4h14m50.826108995s) [upload=4439]: Done uploading segments... Aug 7 13:54:51.236781783 (4h14m50.82612677s) [upload=4439]: Upload finished. err: <nil> Aug 7 13:55:12.852977367 (4h15m12.442322354s) [upload=4449]: Starting upload Aug 7 13:55:12.853067630 (4h15m12.442412617s) [upload=4449]: Done starting upload Aug 7 13:55:12.853125801 (4h15m12.442470788s) [upload=4449]: Uploading segments... Aug 7 13:55:12.853158114 (4h15m12.442503101s) [upload=4449]: Got next segment. Inline: true Aug 7 13:55:12.853162542 (4h15m12.442507519s) [upload=4449]: Waiting for error group managing segments... Aug 7 13:55:12.853197559 (4h15m12.442542536s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:12.853205774 (4h15m12.442550751s) [upload=4449]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:12.853208359 (4h15m12.442553346s) [upload=4449]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:13.125412310 (4h15m12.714757297s) [upload=4449]: Done uploading segments... Aug 7 13:55:13.125437198 (4h15m12.714782195s) [upload=4449]: Upload finished. err: <nil> Aug 7 13:55:47.628821506 (4h15m47.218166493s) [upload=4457]: Starting upload Aug 7 13:55:47.628864678 (4h15m47.218209655s) [upload=4457]: Done starting upload Aug 7 13:55:47.628934532 (4h15m47.218279519s) [upload=4457]: Uploading segments... Aug 7 13:55:47.628978316 (4h15m47.218323293s) [upload=4457]: Got next segment. Inline: true Aug 7 13:55:47.628993244 (4h15m47.218338231s) [upload=4457]: Waiting for error group managing segments... Aug 7 13:55:47.629028732 (4h15m47.218373719s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:55:47.629034243 (4h15m47.21837923s) [upload=4457]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 13:55:47.629036588 (4h15m47.218381575s) [upload=4457]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:55:47.927925053 (4h15m47.51727004s) [upload=4457]: Done uploading segments... Aug 7 13:55:47.927945021 (4h15m47.517290008s) [upload=4457]: Upload finished. err: <nil> Duration: 1.84688103s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X..................X.........................X......XX......] duration: 6.048973638s FAIL (2025-08-07 14:06:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 379a1e9654a2e11db197cba6085d9ca1a53aa639aef84e2a9b0d218a2128f1ca != before 3d2fb1b55f8ebd735fbff3c20592472b8ca42b215f2e645245a8bfe10574650b ======LOGS====== finished. err: <nil> Aug 7 14:01:55.179966005 (4h21m54.769310993s) [upload=4560]: Starting upload Aug 7 14:01:55.180027874 (4h21m54.769372861s) [upload=4560]: Done starting upload Aug 7 14:01:55.180144266 (4h21m54.769489253s) [upload=4560]: Uploading segments... Aug 7 14:01:55.180380849 (4h21m54.769725836s) [upload=4560]: Got next segment. Inline: false Aug 7 14:01:55.180414263 (4h21m54.76975925s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 14:01:55.180418821 (4h21m54.769763808s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 14:01:55.696218378 (4h21m55.285563365s) [seg_pos={0 0}, upload=4560]: Begin upload segment... Aug 7 14:01:55.696261209 (4h21m55.285606196s) [seg_pos={0 0}, upload=4560]: Done begin upload segment. Aug 7 14:01:55.696285175 (4h21m55.285630162s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696421506 (4h21m55.285766503s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696700209 (4h21m55.286045186s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696898969 (4h21m55.286243956s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.696993150 (4h21m55.286338137s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697235754 (4h21m55.286580741s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697291010 (4h21m55.286635997s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697532753 (4h21m55.28687774s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697573731 (4h21m55.286918718s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697921356 (4h21m55.287266343s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.697988324 (4h21m55.287333311s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698150995 (4h21m55.287495982s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698310741 (4h21m55.287655728s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698446340 (4h21m55.287791328s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698593622 (4h21m55.287938609s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698671090 (4h21m55.288016077s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.698843219 (4h21m55.288188206s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:55.699065424 (4h21m55.288410411s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Uploading piece... Aug 7 14:01:56.874315860 (4h21m56.463660847s) [upload=4560]: Next returned nil segment Aug 7 14:01:56.874383459 (4h21m56.463728446s) [upload=4560]: Waiting for error group managing segments... Aug 7 14:01:57.175871398 (4h21m56.765216385s) [noise=true , address=64.49.13.155:4914 , piece_id=4WTEGNBHLDKT7FU4ZHBOXMCGCQEQZOECCDXZ36AIRBFXK7HJMEMA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.621709858 (4h21m57.211054845s) [noise=true , address=104.36.82.23:4451 , piece_id=ZIEI4KSNE3ZUB2EAAEEMP3TEQU6JLU22EVXYD6HALCODCR6M2W7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.634524196 (4h21m57.223869183s) [noise=true , address=104.36.82.36:4648 , piece_id=ZNTL7IT3QKPJWLY7CK3XTMZFNIUQFORSKQ6NXYWBGLORRYD3J66A, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.639033634 (4h21m57.228378621s) [noise=true , address=104.36.82.62:4422 , piece_id=CUKWVUNPGDNPJ53IULXXROM7FMYTA5C3GNBIGYMHQHEMTRKJMPYA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.649834548 (4h21m57.239179545s) [noise=true , address=104.36.82.34:4565 , piece_id=5554GUPBKMWBZLSYBSCVGT62VPHLAU6KQKJZ4D3RQGUGYBQTKSWQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.669716348 (4h21m57.259061335s) [noise=true , address=45.91.116.13:4184 , piece_id=ZLMZYZFI66EKCAAGOQFD5KFNIAH2GGLI2ZQAGS74QSDP726OJ2QQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.686125904 (4h21m57.275470891s) [noise=true , address=45.91.116.11:4124 , piece_id=ZF2NWECU4ECYBK5LBM57EWNGVZK4GP5TRPHDJN3NCDM564R3GVLA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.687869821 (4h21m57.277214808s) [noise=true , address=45.91.116.7:4015 , piece_id=UWCY5JCZXORDTW2O7452QPNUOW5G5WO3IFAOHQ4Y7VWCGKOTOJDA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.697242272 (4h21m57.286587259s) [noise=true , address=104.36.82.12:4170 , piece_id=JNYFNJG2JMCIWGOWNH2KFLR4TAYUHBAG2PLVOWPFY3NPGS3XK7CA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.769442942 (4h21m57.358787929s) [noise=true , address=104.36.82.37:4657 , piece_id=THIARAH55CX7JNZVQQPYI53EYMMXYIIKLA6OZALSIIIPMXKUERIQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.784083974 (4h21m57.373428961s) [noise=true , address=104.36.82.47:4543 , piece_id=ADMNLQJAAL3LBEJKVMRXPE3YD7LQWDNCZZ7NJMZ52ZRPD6F3XKJQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.789657258 (4h21m57.379002245s) [noise=true , address=104.36.82.9:4009 , piece_id=HXBANDR2AIXFHWYVE7Q5HRSZCD6MB63MS5CFIGSSYF27Z4NBDURQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.794090951 (4h21m57.383435938s) [noise=true , address=104.36.82.61:4381 , piece_id=FC7OY57PJSFEXISS7ATZLBKF5ROYJ46IMRLFJJN3JTZZAEESYPTA, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796193133 (4h21m57.38553812s) [noise=true , address=104.36.82.8:4974 , piece_id=FMUFZCB73EPXFNONS4T5HVYIR5LJONVVG2HDSMBUDZPPGKMGG2IQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: <nil> Aug 7 14:01:57.796206829 (4h21m57.385551816s) [seg_pos={0 0}, upload=4560]: Segment reached optimal threshold of 14 pieces. Aug 7 14:01:57.796312842 (4h21m57.385657819s) [noise=true , address=104.36.82.16:4328 , piece_id=OZXU7U6ITSX2TGNZMQEI5XXOP4IEIFVLD4JQJUJYXP26CKMXD7PQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8PSdkLyaiURWkPGhcABSh3481hoswzukT1NKvpTkSp75vKDJ): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796431358 (4h21m57.385776345s) [noise=true , address=104.36.82.58:4276 , piece_id=S365XPUFKRWCH2R73XRSITWS67PBAVJ5HWZRQQNXVLWY3DTJQE7Q, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126tQjCVpoLF4zbVbNH37ZTVbRRt2EK3zndnitxZs5xeQj2CzWr): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796470935 (4h21m57.385815922s) [noise=true , address=104.36.82.15:4281 , piece_id=QXGWPJN2TRKVD3NL3D37FLSUIE5VAFEUIWASXLOMGAZQ6OUFJSDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hDXeAm4tomp1gAkBNjM8x77V76yiruYQmPQ3BZEYPLpJzigo2): protocol: expected piece hash; context canceled; EOF Aug 7 14:01:57.796622314 (4h21m57.385967301s) [noise=true , address=104.36.82.59:4304 , piece_id=5HAYGO6W4DJUF4RLOIAFNLBEDLQ3RZTIUNQV7USEIOMXJFKJJZDQ, seg_pos={0 0}, upload=4560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aK78a6w6pX4fS7DTuJ7uHHvQfPvQjNaVVGgFc2uLGyDzbNXGG): protocol: read tcp 188.166.225.170:60770->104.36.82.59:4304: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 7 14:01:57.796634237 (4h21m57.385979224s) [seg_pos={0 0}, upload=4560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 14:01:57.796719510 (4h21m57.386064497s) [upload=4560]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 14:01:57.796723478 (4h21m57.386068455s) [upload=4560]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 14:01:58.268989039 (4h21m57.858334026s) [upload=4560]: Done uploading segments... Aug 7 14:01:58.269006392 (4h21m57.858351379s) [upload=4560]: Upload finished. err: <nil> Duration: 6.048997604s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)