Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001138827s
FAIL (2025-08-07 21:12:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
21:11:35.434526944 (11h31m35.023871921s) [upload=12017]: Done starting upload
Aug 7 21:11:35.434621335 (11h31m35.023966362s) [upload=12017]: Uploading segments...
Aug 7 21:11:35.434728259 (11h31m35.024073246s) [upload=12017]: Got next segment. Inline: false
Aug 7 21:11:35.434762164 (11h31m35.024107151s) [upload=12017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:11:35.434766152 (11h31m35.024111139s) [upload=12017]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:11:35.668275282 (11h31m35.257620259s) [seg_pos={0 0}, upload=12017]: Begin upload segment...
Aug 7 21:11:35.668321981 (11h31m35.257666968s) [seg_pos={0 0}, upload=12017]: Done begin upload segment.
Aug 7 21:11:35.668348001 (11h31m35.257692988s) [noise=true , address=45.91.116.7:4011 , piece_id=337XKW3GUCNSR6BLKFBPHU4IJUKJH6DYCBZW7ZXJ45SU6S2UZ2LA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.668411813 (11h31m35.2577568s) [noise=true , address=77.90.31.19:4843 , piece_id=AEUFO6KWQTAFBIQNKWDNQ3EL3XC2EKA7ULMHFYASCRS42YQMDLAA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.668705525 (11h31m35.258050512s) [noise=true , address=104.36.82.16:4294 , piece_id=JNKVRT2O7XLGKO5IHUIZCYAPKZ3SCABTR6FFS3M7GPSN7EBLQ4DQ, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.668877424 (11h31m35.258222401s) [noise=true , address=77.90.31.14:4662 , piece_id=X6U7XYH6AQHXARYULW2HSECW64RKAQNIREF3AAKJEK5COFZLLQ2A, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.668970081 (11h31m35.258315068s) [noise=true , address=77.90.31.10:4517 , piece_id=WPBIYBERJSHAGXUKBVSGJREJ6B37MNBOHNYR5GYRSX5N52G2RJ5A, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669186065 (11h31m35.258531052s) [noise=true , address=104.36.82.6:4876 , piece_id=OYGIZ34JUDMX64BFSPRTQIHKCW6ENRCQEYHE7QPNNS2BMPOR7M4Q, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669276127 (11h31m35.258621114s) [noise=true , address=45.91.116.14:4190 , piece_id=VRHZH224IVJRPT5P7C6S5EFPWVTUWZMEURBNSBPZUAONVVUERS3A, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669522218 (11h31m35.258867205s) [noise=true , address=45.91.116.8:4045 , piece_id=PX2WHDM4EYXXB3QZXUFDVEYNI23O5MF5N7UGUMLJY27DTI3L3LMA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669566662 (11h31m35.258911649s) [noise=true , address=77.90.31.16:4733 , piece_id=764U6SFKPDXTZ2LABZAIIMISMPJOBOE6TDZ734OWSFKSVFPVDBZQ, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669830978 (11h31m35.259175965s) [noise=true , address=45.91.116.10:4081 , piece_id=2P5ZU46HRSVSGTAM7R3G3B6PGYATVURICNCAM5R5YPKY44IFKX3Q, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.669869942 (11h31m35.259214929s) [noise=true , address=104.36.82.9:4005 , piece_id=LFBGDFRAYCSOBC6C47OHXPUIXSDEWL3HNAG2H4M25L3IHU3KGHJQ, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.670054415 (11h31m35.259399393s) [noise=true , address=104.36.82.14:4223 , piece_id=4KR6G7VECDZRUMWFPYBXSK4IK27X6YXRSEGOPPLSFWRDTQEM66YA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.670199142 (11h31m35.259544129s) [noise=true , address=45.91.116.6:4973 , piece_id=7MFZLVPY2BFFGMEIBBHTT6UUCFRYWQNDFRDEIN7WULORX37C2EWA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.670281369 (11h31m35.259626357s) [noise=true , address=45.91.116.13:4153 , piece_id=JNIPJGHRPEJFGTZDBSOLPFPI6FNH23VWBO2O4DVFKOCUROKBAMQQ, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.670499076 (11h31m35.259844053s) [noise=true , address=45.91.116.14:4191 , piece_id=64X5WB6NWW7QSOBVMO257IFCOLHCKIL6C3G7EMPVCR5PBMN2XPVA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:35.670765476 (11h31m35.260110453s) [noise=true , address=45.91.116.9:4262 , piece_id=R4TTQXN2BJKQ5WQ734B7WMDXZ3C4NAKBIQECI24WEZR3ZUSRPZEA, seg_pos={0 0}, upload=12017]: Uploading piece...
Aug 7 21:11:37.305581962 (11h31m36.894926949s) [upload=12017]: Next returned nil segment
Aug 7 21:11:37.305598983 (11h31m36.894943961s) [upload=12017]: Waiting for error group managing segments...
Aug 7 21:11:37.704891137 (11h31m37.294236135s) [noise=true , address=45.91.116.10:4081 , piece_id=2P5ZU46HRSVSGTAM7R3G3B6PGYATVURICNCAM5R5YPKY44IFKX3Q, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.722340423 (11h31m37.31168541s) [noise=true , address=104.36.82.16:4294 , piece_id=JNKVRT2O7XLGKO5IHUIZCYAPKZ3SCABTR6FFS3M7GPSN7EBLQ4DQ, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.759508254 (11h31m37.348853241s) [noise=true , address=77.90.31.19:4843 , piece_id=AEUFO6KWQTAFBIQNKWDNQ3EL3XC2EKA7ULMHFYASCRS42YQMDLAA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.774868541 (11h31m37.364213528s) [noise=true , address=77.90.31.10:4517 , piece_id=WPBIYBERJSHAGXUKBVSGJREJ6B37MNBOHNYR5GYRSX5N52G2RJ5A, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.780756907 (11h31m37.370101894s) [noise=true , address=45.91.116.7:4011 , piece_id=337XKW3GUCNSR6BLKFBPHU4IJUKJH6DYCBZW7ZXJ45SU6S2UZ2LA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.816266847 (11h31m37.405611834s) [noise=true , address=104.36.82.6:4876 , piece_id=OYGIZ34JUDMX64BFSPRTQIHKCW6ENRCQEYHE7QPNNS2BMPOR7M4Q, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.828575126 (11h31m37.417920113s) [noise=true , address=77.90.31.16:4733 , piece_id=764U6SFKPDXTZ2LABZAIIMISMPJOBOE6TDZ734OWSFKSVFPVDBZQ, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.844647896 (11h31m37.433992883s) [noise=true , address=45.91.116.8:4045 , piece_id=PX2WHDM4EYXXB3QZXUFDVEYNI23O5MF5N7UGUMLJY27DTI3L3LMA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.867042233 (11h31m37.45638723s) [noise=true , address=104.36.82.14:4223 , piece_id=4KR6G7VECDZRUMWFPYBXSK4IK27X6YXRSEGOPPLSFWRDTQEM66YA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.888714938 (11h31m37.478059925s) [noise=true , address=45.91.116.6:4973 , piece_id=7MFZLVPY2BFFGMEIBBHTT6UUCFRYWQNDFRDEIN7WULORX37C2EWA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.963433603 (11h31m37.55277859s) [noise=true , address=45.91.116.13:4153 , piece_id=JNIPJGHRPEJFGTZDBSOLPFPI6FNH23VWBO2O4DVFKOCUROKBAMQQ, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:37.986126871 (11h31m37.575471858s) [noise=true , address=45.91.116.14:4191 , piece_id=64X5WB6NWW7QSOBVMO257IFCOLHCKIL6C3G7EMPVCR5PBMN2XPVA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:38.073190565 (11h31m37.662535552s) [noise=true , address=77.90.31.14:4662 , piece_id=X6U7XYH6AQHXARYULW2HSECW64RKAQNIREF3AAKJEK5COFZLLQ2A, seg_pos={0 0}, upload=12017]: Done uploading piece. err: <nil>
Aug 7 21:11:38.073212426 (11h31m37.662557413s) [seg_pos={0 0}, upload=12017]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:11:38.073319682 (11h31m37.662664669s) [noise=true , address=45.91.116.9:4262 , piece_id=R4TTQXN2BJKQ5WQ734B7WMDXZ3C4NAKBIQECI24WEZR3ZUSRPZEA, seg_pos={0 0}, upload=12017]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:38.073386219 (11h31m37.662731207s) [noise=true , address=45.91.116.14:4190 , piece_id=VRHZH224IVJRPT5P7C6S5EFPWVTUWZMEURBNSBPZUAONVVUERS3A, seg_pos={0 0}, upload=12017]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:38.073506179 (11h31m37.662851166s) [noise=true , address=104.36.82.9:4005 , piece_id=LFBGDFRAYCSOBC6C47OHXPUIXSDEWL3HNAG2H4M25L3IHU3KGHJQ, seg_pos={0 0}, upload=12017]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: write tcp 188.166.225.170:40678->104.36.82.9:4005: use of closed network connection; write tcp 188.166.225.170:40678->104.36.82.9:4005: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40678->104.36.82.9:4005: use of closed network connection
Aug 7 21:11:38.073542368 (11h31m37.662887355s) [seg_pos={0 0}, upload=12017]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:11:38.073602473 (11h31m37.66294745s) [upload=12017]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:11:38.073634404 (11h31m37.662979391s) [upload=12017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:11:38.377251317 (11h31m37.966596304s) [upload=12017]: Done uploading segments...
Aug 7 21:11:38.377276456 (11h31m37.966621433s) [upload=12017]: Upload finished. err: <nil>
Aug 7 21:12:29.590155214 (11h32m29.179500201s) [upload=12033]: Starting upload
Aug 7 21:12:29.590208055 (11h32m29.179553042s) [upload=12033]: Done starting upload
Aug 7 21:12:29.590306493 (11h32m29.17965148s) [upload=12033]: Uploading segments...
Aug 7 21:12:29.590377449 (11h32m29.179722436s) [upload=12033]: Got next segment. Inline: false
Aug 7 21:12:29.590398359 (11h32m29.179743346s) [upload=12033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:12:29.590401966 (11h32m29.179746953s) [upload=12033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:12:58.939555566 (11h32m58.528900553s) [upload=12033]: Next segment err: context deadline exceeded
Aug 7 21:12:58.939613887 (11h32m58.528958874s) [upload=12033]: Done uploading segments...
Aug 7 21:12:58.939626821 (11h32m58.528971798s) [upload=12033]: Upload finished. err: context deadline exceeded
Duration: 30.001159387s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.00046522s
FAIL (2025-08-07 21:12:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5959385 (11h24m50.225304372s) [upload=11893]: Upload finished. err: <nil> Aug 7 21:05:25.355558074 (11h25m24.944903051s) [upload=11908]: Starting upload Aug 7 21:05:25.355615374 (11h25m24.944960361s) [upload=11908]: Done starting upload Aug 7 21:05:25.355660210 (11h25m24.945005197s) [upload=11908]: Uploading segments... Aug 7 21:05:25.355689586 (11h25m24.945034563s) [upload=11908]: Got next segment. Inline: true Aug 7 21:05:25.355693293 (11h25m24.94503828s) [upload=11908]: Waiting for error group managing segments... Aug 7 21:05:25.355727409 (11h25m24.945072396s) [upload=11908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:05:25.355731426 (11h25m24.945076404s) [upload=11908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:05:25.355733941 (11h25m24.945078928s) [upload=11908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:05:25.663989869 (11h25m25.253334856s) [upload=11908]: Done uploading segments... Aug 7 21:05:25.664007443 (11h25m25.25335242s) [upload=11908]: Upload finished. err: <nil> Aug 7 21:05:47.945556961 (11h25m47.534901948s) [upload=11916]: Starting upload Aug 7 21:05:47.945614611 (11h25m47.534959598s) [upload=11916]: Done starting upload Aug 7 21:05:47.945674546 (11h25m47.535019533s) [upload=11916]: Uploading segments... Aug 7 21:05:47.945704424 (11h25m47.535049411s) [upload=11916]: Got next segment. Inline: true Aug 7 21:05:47.945708231 (11h25m47.535053208s) [upload=11916]: Waiting for error group managing segments... Aug 7 21:05:47.945742226 (11h25m47.535087213s) [upload=11916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:05:47.945746303 (11h25m47.53509129s) [upload=11916]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:05:47.945748708 (11h25m47.535093695s) [upload=11916]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:05:48.221309343 (11h25m47.81065433s) [upload=11916]: Done uploading segments... Aug 7 21:05:48.221332277 (11h25m47.810677304s) [upload=11916]: Upload finished. err: <nil> Aug 7 21:06:29.023021686 (11h26m28.612366673s) [upload=11927]: Starting upload Aug 7 21:06:29.023068907 (11h26m28.612413894s) [upload=11927]: Done starting upload Aug 7 21:06:29.023149912 (11h26m28.612494899s) [upload=11927]: Uploading segments... Aug 7 21:06:29.023185480 (11h26m28.612530457s) [upload=11927]: Got next segment. Inline: true Aug 7 21:06:29.023189928 (11h26m28.612534915s) [upload=11927]: Waiting for error group managing segments... Aug 7 21:06:29.023231568 (11h26m28.612576555s) [upload=11927]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:06:29.023236387 (11h26m28.612581374s) [upload=11927]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:06:29.023239593 (11h26m28.61258458s) [upload=11927]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:06:29.300861462 (11h26m28.890206449s) [upload=11927]: Done uploading segments... Aug 7 21:06:29.300881371 (11h26m28.890226358s) [upload=11927]: Upload finished. err: <nil> Aug 7 21:07:37.321661864 (11h27m36.911006841s) [upload=11949]: Starting upload Aug 7 21:07:37.321718112 (11h27m36.911063099s) [upload=11949]: Done starting upload Aug 7 21:07:37.321771434 (11h27m36.911116411s) [upload=11949]: Uploading segments... Aug 7 21:07:37.321872968 (11h27m36.911217945s) [upload=11949]: Got next segment. Inline: true Aug 7 21:07:37.321877877 (11h27m36.911222865s) [upload=11949]: Waiting for error group managing segments... Aug 7 21:07:37.321923275 (11h27m36.911268262s) [upload=11949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:07:37.321928314 (11h27m36.911273301s) [upload=11949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:07:37.321930418 (11h27m36.911275405s) [upload=11949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:07:37.599927314 (11h27m37.189272301s) [upload=11949]: Done uploading segments... Aug 7 21:07:37.599948635 (11h27m37.189293672s) [upload=11949]: Upload finished. err: <nil> Aug 7 21:08:35.851762080 (11h28m35.441107057s) [upload=11967]: Starting upload Aug 7 21:08:35.851828216 (11h28m35.441173203s) [upload=11967]: Done starting upload Aug 7 21:08:35.851888952 (11h28m35.441233939s) [upload=11967]: Uploading segments... Aug 7 21:08:35.851977722 (11h28m35.441322709s) [upload=11967]: Got next segment. Inline: true Aug 7 21:08:35.851983424 (11h28m35.441328411s) [upload=11967]: Waiting for error group managing segments... Aug 7 21:08:35.852017519 (11h28m35.441362506s) [upload=11967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:08:35.852021105 (11h28m35.441366093s) [upload=11967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:35.852023460 (11h28m35.441368447s) [upload=11967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:08:36.115286628 (11h28m35.704631615s) [upload=11967]: Done uploading segments... Aug 7 21:08:36.115331112 (11h28m35.704676099s) [upload=11967]: Upload finished. err: <nil> Aug 7 21:09:20.788493181 (11h29m20.377838178s) [upload=11976]: Starting upload Aug 7 21:09:20.788595918 (11h29m20.377940965s) [upload=11976]: Done starting upload Aug 7 21:09:20.788684948 (11h29m20.378029975s) [upload=11976]: Uploading segments... Aug 7 21:09:20.788747948 (11h29m20.378092935s) [upload=11976]: Got next segment. Inline: true Aug 7 21:09:20.788756344 (11h29m20.378101361s) [upload=11976]: Waiting for error group managing segments... Aug 7 21:09:20.788807752 (11h29m20.378152739s) [upload=11976]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:09:20.788813985 (11h29m20.378158972s) [upload=11976]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:20.788818584 (11h29m20.378163611s) [upload=11976]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:09:21.070630248 (11h29m20.659975235s) [upload=11976]: Done uploading segments... Aug 7 21:09:21.070652190 (11h29m20.659997247s) [upload=11976]: Upload finished. err: <nil> Aug 7 21:09:46.948530536 (11h29m46.537875523s) [upload=11987]: Starting upload Aug 7 21:09:46.948588607 (11h29m46.537933584s) [upload=11987]: Done starting upload Aug 7 21:09:46.948642600 (11h29m46.537987587s) [upload=11987]: Uploading segments... Aug 7 21:09:46.948702786 (11h29m46.538047773s) [upload=11987]: Got next segment. Inline: true Aug 7 21:09:46.948707776 (11h29m46.538052763s) [upload=11987]: Waiting for error group managing segments... Aug 7 21:09:46.948747241 (11h29m46.538092228s) [upload=11987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:09:46.948752340 (11h29m46.538097327s) [upload=11987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:46.948754896 (11h29m46.538099883s) [upload=11987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:09:47.214261274 (11h29m46.803606261s) [upload=11987]: Done uploading segments... Aug 7 21:09:47.214279799 (11h29m46.803624786s) [upload=11987]: Upload finished. err: <nil> Aug 7 21:10:37.572355395 (11h30m37.161700372s) [upload=11999]: Starting upload Aug 7 21:10:37.572410881 (11h30m37.161755868s) [upload=11999]: Done starting upload Aug 7 21:10:37.572467810 (11h30m37.161812797s) [upload=11999]: Uploading segments... Aug 7 21:10:37.572531982 (11h30m37.161876959s) [upload=11999]: Got next segment. Inline: true Aug 7 21:10:37.572536320 (11h30m37.161881307s) [upload=11999]: Waiting for error group managing segments... Aug 7 21:10:37.572570917 (11h30m37.161915904s) [upload=11999]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:10:37.572574955 (11h30m37.161919942s) [upload=11999]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:37.572577520 (11h30m37.161922507s) [upload=11999]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:10:37.838997375 (11h30m37.428342362s) [upload=11999]: Done uploading segments... Aug 7 21:10:37.839014699 (11h30m37.428359686s) [upload=11999]: Upload finished. err: <nil> Aug 7 21:11:31.258043368 (11h31m30.847388355s) [upload=12015]: Starting upload Aug 7 21:11:31.258101790 (11h31m30.847446777s) [upload=12015]: Done starting upload Aug 7 21:11:31.258163838 (11h31m30.847508825s) [upload=12015]: Uploading segments... Aug 7 21:11:31.258195730 (11h31m30.847540717s) [upload=12015]: Got next segment. Inline: true Aug 7 21:11:31.258199567 (11h31m30.847544565s) [upload=12015]: Waiting for error group managing segments... Aug 7 21:11:31.258240175 (11h31m30.847585162s) [upload=12015]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:11:31.258244853 (11h31m30.847589841s) [upload=12015]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:31.258247358 (11h31m30.847592345s) [upload=12015]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:11:31.535852595 (11h31m31.125197582s) [upload=12015]: Done uploading segments... Aug 7 21:11:31.535871041 (11h31m31.125216028s) [upload=12015]: Upload finished. err: <nil> Aug 7 21:11:57.912240700 (11h31m57.501585687s) [upload=12025]: Starting upload Aug 7 21:11:57.912288532 (11h31m57.501633519s) [upload=12025]: Done starting upload Aug 7 21:11:57.912345871 (11h31m57.501690858s) [upload=12025]: Uploading segments... Aug 7 21:11:57.912374877 (11h31m57.501719874s) [upload=12025]: Got next segment. Inline: true Aug 7 21:11:57.912378794 (11h31m57.501723781s) [upload=12025]: Waiting for error group managing segments... Aug 7 21:11:57.912425353 (11h31m57.501770401s) [upload=12025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:11:57.912431234 (11h31m57.501776232s) [upload=12025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:57.912435933 (11h31m57.50178095s) [upload=12025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.261749711 (11h32m56.851094698s) [upload=12025]: Done uploading segments... Aug 7 21:12:57.261780350 (11h32m56.851125337s) [upload=12025]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.000485699s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........XX.......................X.........................] duration:
2.10521445s
FAIL (2025-08-07 21:12:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.105236903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................XX...........X.......................X.] duration:
6.669855592s
FAIL (2025-08-07 21:12:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
7106407 (11h31m46.936451394s) [upload=12022]: Uploading segments...
Aug 7 21:11:47.347198184 (11h31m46.936543161s) [upload=12022]: Got next segment. Inline: false
Aug 7 21:11:47.347234122 (11h31m46.936579109s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:11:47.347237969 (11h31m46.936582956s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:11:47.802049075 (11h31m47.391394053s) [seg_pos={0 0}, upload=12022]: Begin upload segment...
Aug 7 21:11:47.802118007 (11h31m47.391462994s) [seg_pos={0 0}, upload=12022]: Done begin upload segment.
Aug 7 21:11:47.802142414 (11h31m47.391487401s) [noise=true , address=104.36.82.22:4541 , piece_id=Q5X72MXPD2VX3TRLK37VB3OV5Y4WLD4P6CWPAVL2X4D6BSIIOFSQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802186428 (11h31m47.391531415s) [noise=true , address=104.36.82.5:4846 , piece_id=6NNDPTLCBYLGFWU2H57AIRLEEXTREPMET5R2YZETWQYPIP2ZUHHQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802550154 (11h31m47.391895141s) [noise=true , address=104.36.82.46:4501 , piece_id=CVPKLEXG5FMF3NAR3ONF7LGIWUXJ7OSF5BBOTJ3BLQE4CFFNQKBA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802702837 (11h31m47.392047814s) [noise=true , address=45.91.116.9:4268 , piece_id=VJP2ZZ3UMB2XMXGDGIV45YOLKHRNNJORX2NIB3SHBCI4UZNJEN7A, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802844608 (11h31m47.392189595s) [noise=true , address=104.36.82.16:4328 , piece_id=BFL3YNCSEKYNXJV6PJDPERHGUC6PDQZ52JNSLZDZPH3DCLYCAJPA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803081390 (11h31m47.392426377s) [noise=true , address=104.36.82.47:4523 , piece_id=4WH6OVD7YSUMLPUBHAQPDR5VYX7Y36WKS3MSM7ULY6CI73BALULQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803116328 (11h31m47.392461315s) [noise=true , address=45.91.116.11:4150 , piece_id=64KLQELYVF4SAJJYCFSQD3X5USFFYLXGNOJOQGZ36LOYOFEJ2UBQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803402735 (11h31m47.392747722s) [noise=true , address=104.36.82.12:4165 , piece_id=BBVGOIQK3IBDXSA5KXGHV4Z4TRPZYJQGJT3PYQJXZUI7ZJ55KRJA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803414909 (11h31m47.392759896s) [noise=true , address=104.36.82.39:4752 , piece_id=ITMK3WWPOHUBVDUV2ZUL65XLBGCIVZKGUD544R2K3FCAMTQN5TXQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803693041 (11h31m47.393038028s) [noise=true , address=104.36.82.36:4622 , piece_id=JYCNDCLZYJWGEB4ZWJM5ES3G25WPLBPOY6UGXI37SFC467KTIZEA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803929323 (11h31m47.39327431s) [noise=true , address=104.36.82.42:4813 , piece_id=UAXL4ZUQ4W6P3DLPKIWW7KC3U2MZPZQ25ZA7Z4A7BFQ42EMJZAXQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804163892 (11h31m47.393508879s) [noise=true , address=104.36.82.58:4269 , piece_id=QX6CM6DHSIW2KXY2Z6NRMSRG3HMBRNBQ3JRPHXBGOQMEL5HVZ5ZQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804383622 (11h31m47.393728609s) [noise=true , address=45.91.116.4:4969 , piece_id=GVQDU7BRCLA6PHFSRGOJZBAV6QZQRI2ZEG3EM6I2TJAZ4JAE4P7Q, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804621557 (11h31m47.393966544s) [noise=true , address=104.36.82.23:4453 , piece_id=BLRIGJ5Z3NNUPUHC2YZW4PDMK2SDUVPE75GO5T4WSFTT2FDOEEOQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804837270 (11h31m47.394182257s) [noise=true , address=104.36.82.2:4744 , piece_id=V6TRPHHDLGWKVLQH7BT6AVYVOKVVP3EHL67D62SPHAKNMWICYJWQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804911372 (11h31m47.394256359s) [noise=true , address=104.36.82.43:4849 , piece_id=IZH45DQEPVT7WEQ2UDAAA7OS37XKMKG4VBJRRUEKQ3G36YUM2LMQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.805071538 (11h31m47.394416515s) [noise=true , address=64.49.13.170:4728 , piece_id=LED5VGYENQQBGOP3UH4NKT6O6TH4M6OEZCIXZ5N7AYWFLW452KSA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.805261793 (11h31m47.39460677s) [noise=true , address=104.36.82.44:4899 , piece_id=I5PVQ6WHWORI2TFF2SJSZDAUDH3FX5DVNPP23VC6JECMDAO6ZM6Q, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:48.969580099 (11h31m48.558925086s) [upload=12022]: Next returned nil segment
Aug 7 21:11:48.969596991 (11h31m48.558941978s) [upload=12022]: Waiting for error group managing segments...
Aug 7 21:11:49.265222255 (11h31m48.854567242s) [noise=true , address=64.49.13.170:4728 , piece_id=LED5VGYENQQBGOP3UH4NKT6O6TH4M6OEZCIXZ5N7AYWFLW452KSA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.737280759 (11h31m49.326625746s) [noise=true , address=104.36.82.58:4269 , piece_id=QX6CM6DHSIW2KXY2Z6NRMSRG3HMBRNBQ3JRPHXBGOQMEL5HVZ5ZQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.753249862 (11h31m49.342594849s) [noise=true , address=104.36.82.12:4165 , piece_id=BBVGOIQK3IBDXSA5KXGHV4Z4TRPZYJQGJT3PYQJXZUI7ZJ55KRJA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.780910703 (11h31m49.37025569s) [noise=true , address=45.91.116.9:4268 , piece_id=VJP2ZZ3UMB2XMXGDGIV45YOLKHRNNJORX2NIB3SHBCI4UZNJEN7A, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.813098015 (11h31m49.402442992s) [noise=true , address=104.36.82.46:4501 , piece_id=CVPKLEXG5FMF3NAR3ONF7LGIWUXJ7OSF5BBOTJ3BLQE4CFFNQKBA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.827616893 (11h31m49.41696188s) [noise=true , address=104.36.82.42:4813 , piece_id=UAXL4ZUQ4W6P3DLPKIWW7KC3U2MZPZQ25ZA7Z4A7BFQ42EMJZAXQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.844644011 (11h31m49.433988998s) [noise=true , address=104.36.82.5:4846 , piece_id=6NNDPTLCBYLGFWU2H57AIRLEEXTREPMET5R2YZETWQYPIP2ZUHHQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.896979020 (11h31m49.486324007s) [noise=true , address=104.36.82.16:4328 , piece_id=BFL3YNCSEKYNXJV6PJDPERHGUC6PDQZ52JNSLZDZPH3DCLYCAJPA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.913302922 (11h31m49.502647909s) [noise=true , address=104.36.82.36:4622 , piece_id=JYCNDCLZYJWGEB4ZWJM5ES3G25WPLBPOY6UGXI37SFC467KTIZEA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.928574831 (11h31m49.517919809s) [noise=true , address=104.36.82.22:4541 , piece_id=Q5X72MXPD2VX3TRLK37VB3OV5Y4WLD4P6CWPAVL2X4D6BSIIOFSQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.967608171 (11h31m49.556953148s) [noise=true , address=104.36.82.43:4849 , piece_id=IZH45DQEPVT7WEQ2UDAAA7OS37XKMKG4VBJRRUEKQ3G36YUM2LMQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.087000568 (11h31m49.676345555s) [noise=true , address=45.91.116.11:4150 , piece_id=64KLQELYVF4SAJJYCFSQD3X5USFFYLXGNOJOQGZ36LOYOFEJ2UBQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.098037264 (11h31m49.687382241s) [noise=true , address=45.91.116.4:4969 , piece_id=GVQDU7BRCLA6PHFSRGOJZBAV6QZQRI2ZEG3EM6I2TJAZ4JAE4P7Q, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.160148408 (11h31m49.749493395s) [noise=true , address=104.36.82.47:4523 , piece_id=4WH6OVD7YSUMLPUBHAQPDR5VYX7Y36WKS3MSM7ULY6CI73BALULQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.160172064 (11h31m49.749517051s) [seg_pos={0 0}, upload=12022]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:11:50.160367668 (11h31m49.749712655s) [noise=true , address=104.36.82.44:4899 , piece_id=I5PVQ6WHWORI2TFF2SJSZDAUDH3FX5DVNPP23VC6JECMDAO6ZM6Q, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:50.160428794 (11h31m49.749773782s) [noise=true , address=104.36.82.23:4453 , piece_id=BLRIGJ5Z3NNUPUHC2YZW4PDMK2SDUVPE75GO5T4WSFTT2FDOEEOQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ktniPbRibXzsTSNW9MbWWxymt9gZKU8sDgTjixc6nYzT9c5tJ): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:50.160601615 (11h31m49.749946592s) [noise=true , address=104.36.82.2:4744 , piece_id=V6TRPHHDLGWKVLQH7BT6AVYVOKVVP3EHL67D62SPHAKNMWICYJWQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH): protocol: read tcp 188.166.225.170:55148->104.36.82.2:4744: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:11:50.160658343 (11h31m49.75000333s) [noise=true , address=104.36.82.39:4752 , piece_id=ITMK3WWPOHUBVDUV2ZUL65XLBGCIVZKGUD544R2K3FCAMTQN5TXQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: read tcp 188.166.225.170:46618->104.36.82.39:4752: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:11:50.160688220 (11h31m49.750033207s) [seg_pos={0 0}, upload=12022]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:11:50.160746132 (11h31m49.750091179s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:11:50.160752644 (11h31m49.750097651s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:11:50.684435488 (11h31m50.273780475s) [upload=12022]: Done uploading segments...
Aug 7 21:11:50.684472599 (11h31m50.273817576s) [upload=12022]: Upload finished. err: <nil>
Duration: 6.669883676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.149124644s
FAIL (2025-08-07 21:12:45 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.149151475s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000520361s
FAIL (2025-08-07 21:12:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 30.000540621s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........XX.......................X........................] duration:
1.864391939s
FAIL (2025-08-07 21:12:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.864418851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................XX...........X.......................X] duration:
4.458722199s
FAIL (2025-08-07 21:11:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
7106407 (11h31m46.936451394s) [upload=12022]: Uploading segments...
Aug 7 21:11:47.347198184 (11h31m46.936543161s) [upload=12022]: Got next segment. Inline: false
Aug 7 21:11:47.347234122 (11h31m46.936579109s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:11:47.347237969 (11h31m46.936582956s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:11:47.802049075 (11h31m47.391394053s) [seg_pos={0 0}, upload=12022]: Begin upload segment...
Aug 7 21:11:47.802118007 (11h31m47.391462994s) [seg_pos={0 0}, upload=12022]: Done begin upload segment.
Aug 7 21:11:47.802142414 (11h31m47.391487401s) [noise=true , address=104.36.82.22:4541 , piece_id=Q5X72MXPD2VX3TRLK37VB3OV5Y4WLD4P6CWPAVL2X4D6BSIIOFSQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802186428 (11h31m47.391531415s) [noise=true , address=104.36.82.5:4846 , piece_id=6NNDPTLCBYLGFWU2H57AIRLEEXTREPMET5R2YZETWQYPIP2ZUHHQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802550154 (11h31m47.391895141s) [noise=true , address=104.36.82.46:4501 , piece_id=CVPKLEXG5FMF3NAR3ONF7LGIWUXJ7OSF5BBOTJ3BLQE4CFFNQKBA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802702837 (11h31m47.392047814s) [noise=true , address=45.91.116.9:4268 , piece_id=VJP2ZZ3UMB2XMXGDGIV45YOLKHRNNJORX2NIB3SHBCI4UZNJEN7A, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.802844608 (11h31m47.392189595s) [noise=true , address=104.36.82.16:4328 , piece_id=BFL3YNCSEKYNXJV6PJDPERHGUC6PDQZ52JNSLZDZPH3DCLYCAJPA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803081390 (11h31m47.392426377s) [noise=true , address=104.36.82.47:4523 , piece_id=4WH6OVD7YSUMLPUBHAQPDR5VYX7Y36WKS3MSM7ULY6CI73BALULQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803116328 (11h31m47.392461315s) [noise=true , address=45.91.116.11:4150 , piece_id=64KLQELYVF4SAJJYCFSQD3X5USFFYLXGNOJOQGZ36LOYOFEJ2UBQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803402735 (11h31m47.392747722s) [noise=true , address=104.36.82.12:4165 , piece_id=BBVGOIQK3IBDXSA5KXGHV4Z4TRPZYJQGJT3PYQJXZUI7ZJ55KRJA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803414909 (11h31m47.392759896s) [noise=true , address=104.36.82.39:4752 , piece_id=ITMK3WWPOHUBVDUV2ZUL65XLBGCIVZKGUD544R2K3FCAMTQN5TXQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803693041 (11h31m47.393038028s) [noise=true , address=104.36.82.36:4622 , piece_id=JYCNDCLZYJWGEB4ZWJM5ES3G25WPLBPOY6UGXI37SFC467KTIZEA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.803929323 (11h31m47.39327431s) [noise=true , address=104.36.82.42:4813 , piece_id=UAXL4ZUQ4W6P3DLPKIWW7KC3U2MZPZQ25ZA7Z4A7BFQ42EMJZAXQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804163892 (11h31m47.393508879s) [noise=true , address=104.36.82.58:4269 , piece_id=QX6CM6DHSIW2KXY2Z6NRMSRG3HMBRNBQ3JRPHXBGOQMEL5HVZ5ZQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804383622 (11h31m47.393728609s) [noise=true , address=45.91.116.4:4969 , piece_id=GVQDU7BRCLA6PHFSRGOJZBAV6QZQRI2ZEG3EM6I2TJAZ4JAE4P7Q, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804621557 (11h31m47.393966544s) [noise=true , address=104.36.82.23:4453 , piece_id=BLRIGJ5Z3NNUPUHC2YZW4PDMK2SDUVPE75GO5T4WSFTT2FDOEEOQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804837270 (11h31m47.394182257s) [noise=true , address=104.36.82.2:4744 , piece_id=V6TRPHHDLGWKVLQH7BT6AVYVOKVVP3EHL67D62SPHAKNMWICYJWQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.804911372 (11h31m47.394256359s) [noise=true , address=104.36.82.43:4849 , piece_id=IZH45DQEPVT7WEQ2UDAAA7OS37XKMKG4VBJRRUEKQ3G36YUM2LMQ, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.805071538 (11h31m47.394416515s) [noise=true , address=64.49.13.170:4728 , piece_id=LED5VGYENQQBGOP3UH4NKT6O6TH4M6OEZCIXZ5N7AYWFLW452KSA, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:47.805261793 (11h31m47.39460677s) [noise=true , address=104.36.82.44:4899 , piece_id=I5PVQ6WHWORI2TFF2SJSZDAUDH3FX5DVNPP23VC6JECMDAO6ZM6Q, seg_pos={0 0}, upload=12022]: Uploading piece...
Aug 7 21:11:48.969580099 (11h31m48.558925086s) [upload=12022]: Next returned nil segment
Aug 7 21:11:48.969596991 (11h31m48.558941978s) [upload=12022]: Waiting for error group managing segments...
Aug 7 21:11:49.265222255 (11h31m48.854567242s) [noise=true , address=64.49.13.170:4728 , piece_id=LED5VGYENQQBGOP3UH4NKT6O6TH4M6OEZCIXZ5N7AYWFLW452KSA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.737280759 (11h31m49.326625746s) [noise=true , address=104.36.82.58:4269 , piece_id=QX6CM6DHSIW2KXY2Z6NRMSRG3HMBRNBQ3JRPHXBGOQMEL5HVZ5ZQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.753249862 (11h31m49.342594849s) [noise=true , address=104.36.82.12:4165 , piece_id=BBVGOIQK3IBDXSA5KXGHV4Z4TRPZYJQGJT3PYQJXZUI7ZJ55KRJA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.780910703 (11h31m49.37025569s) [noise=true , address=45.91.116.9:4268 , piece_id=VJP2ZZ3UMB2XMXGDGIV45YOLKHRNNJORX2NIB3SHBCI4UZNJEN7A, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.813098015 (11h31m49.402442992s) [noise=true , address=104.36.82.46:4501 , piece_id=CVPKLEXG5FMF3NAR3ONF7LGIWUXJ7OSF5BBOTJ3BLQE4CFFNQKBA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.827616893 (11h31m49.41696188s) [noise=true , address=104.36.82.42:4813 , piece_id=UAXL4ZUQ4W6P3DLPKIWW7KC3U2MZPZQ25ZA7Z4A7BFQ42EMJZAXQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.844644011 (11h31m49.433988998s) [noise=true , address=104.36.82.5:4846 , piece_id=6NNDPTLCBYLGFWU2H57AIRLEEXTREPMET5R2YZETWQYPIP2ZUHHQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.896979020 (11h31m49.486324007s) [noise=true , address=104.36.82.16:4328 , piece_id=BFL3YNCSEKYNXJV6PJDPERHGUC6PDQZ52JNSLZDZPH3DCLYCAJPA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.913302922 (11h31m49.502647909s) [noise=true , address=104.36.82.36:4622 , piece_id=JYCNDCLZYJWGEB4ZWJM5ES3G25WPLBPOY6UGXI37SFC467KTIZEA, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.928574831 (11h31m49.517919809s) [noise=true , address=104.36.82.22:4541 , piece_id=Q5X72MXPD2VX3TRLK37VB3OV5Y4WLD4P6CWPAVL2X4D6BSIIOFSQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:49.967608171 (11h31m49.556953148s) [noise=true , address=104.36.82.43:4849 , piece_id=IZH45DQEPVT7WEQ2UDAAA7OS37XKMKG4VBJRRUEKQ3G36YUM2LMQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.087000568 (11h31m49.676345555s) [noise=true , address=45.91.116.11:4150 , piece_id=64KLQELYVF4SAJJYCFSQD3X5USFFYLXGNOJOQGZ36LOYOFEJ2UBQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.098037264 (11h31m49.687382241s) [noise=true , address=45.91.116.4:4969 , piece_id=GVQDU7BRCLA6PHFSRGOJZBAV6QZQRI2ZEG3EM6I2TJAZ4JAE4P7Q, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.160148408 (11h31m49.749493395s) [noise=true , address=104.36.82.47:4523 , piece_id=4WH6OVD7YSUMLPUBHAQPDR5VYX7Y36WKS3MSM7ULY6CI73BALULQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: <nil>
Aug 7 21:11:50.160172064 (11h31m49.749517051s) [seg_pos={0 0}, upload=12022]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:11:50.160367668 (11h31m49.749712655s) [noise=true , address=104.36.82.44:4899 , piece_id=I5PVQ6WHWORI2TFF2SJSZDAUDH3FX5DVNPP23VC6JECMDAO6ZM6Q, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:50.160428794 (11h31m49.749773782s) [noise=true , address=104.36.82.23:4453 , piece_id=BLRIGJ5Z3NNUPUHC2YZW4PDMK2SDUVPE75GO5T4WSFTT2FDOEEOQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ktniPbRibXzsTSNW9MbWWxymt9gZKU8sDgTjixc6nYzT9c5tJ): protocol: expected piece hash; context canceled; EOF
Aug 7 21:11:50.160601615 (11h31m49.749946592s) [noise=true , address=104.36.82.2:4744 , piece_id=V6TRPHHDLGWKVLQH7BT6AVYVOKVVP3EHL67D62SPHAKNMWICYJWQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH): protocol: read tcp 188.166.225.170:55148->104.36.82.2:4744: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:11:50.160658343 (11h31m49.75000333s) [noise=true , address=104.36.82.39:4752 , piece_id=ITMK3WWPOHUBVDUV2ZUL65XLBGCIVZKGUD544R2K3FCAMTQN5TXQ, seg_pos={0 0}, upload=12022]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: read tcp 188.166.225.170:46618->104.36.82.39:4752: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:11:50.160688220 (11h31m49.750033207s) [seg_pos={0 0}, upload=12022]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:11:50.160746132 (11h31m49.750091179s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:11:50.160752644 (11h31m49.750097651s) [upload=12022]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:11:50.684435488 (11h31m50.273780475s) [upload=12022]: Done uploading segments...
Aug 7 21:11:50.684472599 (11h31m50.273817576s) [upload=12022]: Upload finished. err: <nil>
Duration: 4.45874868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........XX.......................X.......................] duration:
1.868894293s
FAIL (2025-08-07 21:11:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.868917457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................XX...........X.......................] duration:
5.860518391s
FAIL (2025-08-07 21:10:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 5.860550354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............XX.......................X......................] duration:
1.948655316s
FAIL (2025-08-07 21:10:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.948686136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............XX.......................X.....................] duration:
1.875680318s
FAIL (2025-08-07 21:10:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.875713692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................XX...........X......................] duration:
6.312730168s
FAIL (2025-08-07 21:09:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.312754585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............XX.......................X....................] duration:
1.99867612s
FAIL (2025-08-07 21:09:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.998695217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................XX...........X.....................] duration:
6.179199194s
FAIL (2025-08-07 21:08:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.179224683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............XX.......................X...................] duration:
2.032699051s
FAIL (2025-08-07 21:08:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.032726854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................XX.......................X..................] duration:
2.054747999s
FAIL (2025-08-07 21:07:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.054771694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................XX...........X....................] duration:
5.814639845s
FAIL (2025-08-07 21:07:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 5.814661115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................XX...........X...................] duration:
6.648635753s
FAIL (2025-08-07 21:07:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.648663468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................XX.......................X.................] duration:
2.039985661s
FAIL (2025-08-07 21:06:35 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.040014267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................XX...........X..................] duration:
6.851905594s
FAIL (2025-08-07 21:06:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.851925241s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................XX.......................X................] duration:
2.091068617s
FAIL (2025-08-07 21:05:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.091107201s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX...........X.................] duration:
7.153957905s
FAIL (2025-08-07 21:05:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 7.153984787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................XX.......................X...............] duration:
1.885040133s
FAIL (2025-08-07 21:04:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.885065992s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX...........X................] duration:
6.456711679s
FAIL (2025-08-07 21:04:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.456739433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................XX.......................X..............] duration:
1.926417961s
FAIL (2025-08-07 21:03:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.92644803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX...........X...............] duration:
6.932021864s
FAIL (2025-08-07 21:03:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.932052451s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................XX.......................X.............] duration:
1.871131364s
FAIL (2025-08-07 21:02:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.871157935s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................XX...........X..............] duration:
5.88275781s
FAIL (2025-08-07 21:02:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 5.88278905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................XX.......................X............] duration:
1.848132102s
FAIL (2025-08-07 21:01:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.848155355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................XX...........X.............] duration:
6.937320238s
FAIL (2025-08-07 21:00:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.937345084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................XX.......................X...........] duration:
2.054670023s
FAIL (2025-08-07 21:00:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.054698979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX...........X............] duration:
7.69454134s
FAIL (2025-08-07 21:00:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 7.694566919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................XX.......................X..........] duration:
2.091414727s
FAIL (2025-08-07 20:59:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.091444364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................XX...........X...........] duration:
6.04323761s
FAIL (2025-08-07 20:59:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.043261796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................XX...........X..........] duration:
7.242905902s
FAIL (2025-08-07 20:59:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 7.242927835s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................XX.......................X.........] duration:
1.902981308s
FAIL (2025-08-07 20:59:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.903011555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X....................................XX...........X.........] duration:
6.692576083s
FAIL (2025-08-07 20:58:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.692608905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................XX.......................X........] duration:
1.926624685s
FAIL (2025-08-07 20:58:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.926641536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................XX.......................X.......] duration:
1.903305019s
FAIL (2025-08-07 20:57:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.903324025s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X....................................XX...........X........] duration:
6.088155166s
FAIL (2025-08-07 20:57:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.088180554s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X....................................XX...........X.......] duration:
6.565566045s
FAIL (2025-08-07 20:57:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.565597624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X....................................XX...........X......] duration:
6.194852387s
FAIL (2025-08-07 20:56:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.194870672s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................XX.......................X......] duration:
1.966774761s
FAIL (2025-08-07 20:56:30 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.966813336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX.......................X.....] duration:
2.692332953s
FAIL (2025-08-07 20:56:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 2.692357721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X....................................XX...........X.....] duration:
5.934695252s
FAIL (2025-08-07 20:55:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 5.934722504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X....................................XX...........X....] duration:
6.187890379s
FAIL (2025-08-07 20:55:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.187919164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX.......................X....] duration:
1.845820838s
FAIL (2025-08-07 20:55:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.845846117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X....................................XX...........X...] duration:
6.283705709s
FAIL (2025-08-07 20:54:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
ing upload
Aug 7 20:52:13.374836891 (11h12m12.964181878s) [upload=11678]: Uploading segments...
Aug 7 20:52:13.374920110 (11h12m12.964265097s) [upload=11678]: Got next segment. Inline: false
Aug 7 20:52:13.374961219 (11h12m12.964306207s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 20:52:13.374965788 (11h12m12.964310775s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 20:52:13.826020973 (11h12m13.415366s) [seg_pos={0 0}, upload=11678]: Begin upload segment...
Aug 7 20:52:13.826081649 (11h12m13.415426656s) [seg_pos={0 0}, upload=11678]: Done begin upload segment.
Aug 7 20:52:13.826093642 (11h12m13.415438629s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826113379 (11h12m13.415458386s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826502184 (11h12m13.415847171s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826728948 (11h12m13.416073925s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826952846 (11h12m13.416297833s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.826976982 (11h12m13.416322009s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827480165 (11h12m13.416825192s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827716647 (11h12m13.417061634s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827857517 (11h12m13.417202494s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.827938161 (11h12m13.417283148s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828148693 (11h12m13.41749368s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828191205 (11h12m13.417536192s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828387460 (11h12m13.417732448s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.828627209 (11h12m13.417972207s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829107849 (11h12m13.418452836s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829360241 (11h12m13.418705238s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829586294 (11h12m13.418931291s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:13.829963265 (11h12m13.419308252s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Uploading piece...
Aug 7 20:52:14.979772599 (11h12m14.569117576s) [upload=11678]: Next returned nil segment
Aug 7 20:52:14.979790323 (11h12m14.5691353s) [upload=11678]: Waiting for error group managing segments...
Aug 7 20:52:15.289460825 (11h12m14.878805842s) [noise=true , address=64.49.13.137:4497 , piece_id=K3TVOBYZKUSBNKLWACAEK6WM7YNZ7VFMIPDSLC3IBFAWW4TIX3WA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.322283383 (11h12m14.91162837s) [noise=true , address=64.49.13.27:4960 , piece_id=4ZSML5DKMD5EHJOXCRV4YKLAPXANRNK2USD6YLASSJ64O6QZD5ZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.353535855 (11h12m14.942880842s) [noise=true , address=193.149.164.143:4698 , piece_id=357UGHDYBLWJ2F27PZOP4UURYY56FLX3MLSQCQ3DMGP56CBOEKDQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.738874078 (11h12m15.328219065s) [noise=true , address=104.36.82.9:4017 , piece_id=VQ26SINBRJ4CSM5IBX6BCQJFGK3S7T6GJK46OPFHE4LOA4FGITGQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.748447725 (11h12m15.337792712s) [noise=true , address=104.36.82.16:4321 , piece_id=OGTRGKEPB6FE6WDZEIBQDYJZQWDT23ZNUS2BAIPLPE7TS6RZJHXA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.842335664 (11h12m15.431680651s) [noise=true , address=104.36.82.37:4664 , piece_id=KMRTK653AS35ZGP5LTRSD2LDYP6ZUDAABTK3FGMOIMW75GL3UNKQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.878990634 (11h12m15.468335621s) [noise=true , address=104.36.82.18:4399 , piece_id=BMDEZOUV446K4LMGYMKIT7B2VHTIVMO5DTUOJDB376MGNVOMK24A, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:15.964491097 (11h12m15.553836074s) [noise=true , address=104.36.82.60:4366 , piece_id=NEGCADK4UTLB4UOFBUIPYBULWFSV6ZHEIBLUD3QG3U7ITNBH5XMA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.094244865 (11h12m15.683589853s) [noise=true , address=45.91.116.10:4105 , piece_id=F5ZQS2R3SOPTX27RPCLAAKTIC6DERUHMXLG3YAYTIE3IHGB32ULA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.112059610 (11h12m15.701404597s) [noise=true , address=104.36.82.15:4276 , piece_id=K5UELPYKGNOKRXFETWYGTVMTQY4DGGUZTXWJG5WMNTRGM6YFUCZQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.137625954 (11h12m15.726970941s) [noise=true , address=77.90.31.18:4835 , piece_id=ENVUDLZ62HY6552KIG4MKP5NEKRFVAIZ77V5Z5PPPI5MVHFRZARQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.241150891 (11h12m15.830495878s) [noise=true , address=104.36.82.38:4719 , piece_id=N5V5PHKSOBNEPOPTPR3QZU6CQHMMB6EMPRJ7Z3Z2FUJD4UK5WTAA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.273629280 (11h12m15.862974257s) [noise=true , address=45.91.116.5:4309 , piece_id=I345EAVCT5R2UPIE7PC2JBLPUU4BZDPCHGRRW4EUYSODY3EB5MRQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354312235 (11h12m15.943657222s) [noise=true , address=104.36.82.39:4734 , piece_id=CCJIVYAFIPWRROZIKQTYHMVOEG7UYB3LTJNFVLQEBZALHBGM4QUQ, seg_pos={0 0}, upload=11678]: Done uploading piece. err: <nil>
Aug 7 20:52:16.354348654 (11h12m15.943693662s) [seg_pos={0 0}, upload=11678]: Segment reached optimal threshold of 14 pieces.
Aug 7 20:52:16.354607220 (11h12m15.943952217s) [noise=true , address=104.36.82.61:4396 , piece_id=KBP7HN4BMQZUHZ7MHTDGZM4CHTNMOSRKACGV72FE47JVK53JV3TA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDCfMD1mxh7t5V5SHkwfFk4KYgPTj4qL2sgygCyVhVUF7FBXY): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354756896 (11h12m15.944101883s) [noise=true , address=104.36.82.3:4782 , piece_id=3Z5JCZXC5C4HL7QLS3DIJH5QE3VSTMKX5XBLNKTQARUYCUWKDNJA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ): protocol: write tcp 188.166.225.170:36322->104.36.82.3:4782: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354887275 (11h12m15.944232262s) [noise=true , address=104.36.82.34:4546 , piece_id=7KNHVT4LTJCR7WABKXIXMQCSTYV4QHGAEV7GBUDAFMBHPY4LBTFA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMTFpqfMjeVWXJuvsGdbGkMtGQn6axUZFoU1N9sK6fnbPcMy5): protocol: rpc: dial tcp 104.36.82.34:4546: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 20:52:16.354901452 (11h12m15.944246439s) [noise=true , address=104.36.82.54:4174 , piece_id=AFV2Q7Q3FDXNJJNLNNW575STBO632WUBJFCYE2XELVSWIAXA5FLA, seg_pos={0 0}, upload=11678]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF
Aug 7 20:52:16.354915910 (11h12m15.944260897s) [seg_pos={0 0}, upload=11678]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 20:52:16.355022174 (11h12m15.944367161s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 20:52:16.355027794 (11h12m15.944372781s) [upload=11678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 20:52:16.662332280 (11h12m16.251677267s) [upload=11678]: Done uploading segments...
Aug 7 20:52:16.662351206 (11h12m16.251696193s) [upload=11678]: Upload finished. err: <nil>
Duration: 6.283743381s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX.......................X...] duration:
1.932692654s
FAIL (2025-08-07 20:54:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== *pb.BatchRequestItem_ObjectCommit Aug 7 20:43:37.067799677 (11h3m36.657144664s) [upload=11534]: Done uploading segments... Aug 7 20:43:37.067817170 (11h3m36.657162157s) [upload=11534]: Upload finished. err: <nil> Aug 7 20:44:07.448276030 (11h4m7.037621017s) [upload=11539]: Starting upload Aug 7 20:44:07.448326927 (11h4m7.037671904s) [upload=11539]: Done starting upload Aug 7 20:44:07.448378606 (11h4m7.037723593s) [upload=11539]: Uploading segments... Aug 7 20:44:07.448408994 (11h4m7.037753981s) [upload=11539]: Got next segment. Inline: true Aug 7 20:44:07.448414504 (11h4m7.037759491s) [upload=11539]: Waiting for error group managing segments... Aug 7 20:44:07.448448068 (11h4m7.037793055s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:44:07.448451785 (11h4m7.037796762s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:44:07.448454070 (11h4m7.037799057s) [upload=11539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:44:07.799942249 (11h4m7.389287236s) [upload=11539]: Done uploading segments... Aug 7 20:44:07.799959912 (11h4m7.389304899s) [upload=11539]: Upload finished. err: <nil> Aug 7 20:45:19.440040944 (11h5m19.029385921s) [upload=11564]: Starting upload Aug 7 20:45:19.440090409 (11h5m19.029435386s) [upload=11564]: Done starting upload Aug 7 20:45:19.440146045 (11h5m19.029491032s) [upload=11564]: Uploading segments... Aug 7 20:45:19.440190359 (11h5m19.029535346s) [upload=11564]: Got next segment. Inline: true Aug 7 20:45:19.440194267 (11h5m19.029539254s) [upload=11564]: Waiting for error group managing segments... Aug 7 20:45:19.440226098 (11h5m19.029571085s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:45:19.440230026 (11h5m19.029575013s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:45:19.440232290 (11h5m19.029577277s) [upload=11564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:45:19.858443364 (11h5m19.447788352s) [upload=11564]: Done uploading segments... Aug 7 20:45:19.858467080 (11h5m19.447812067s) [upload=11564]: Upload finished. err: <nil> Aug 7 20:46:00.840349205 (11h6m0.429694192s) [upload=11575]: Starting upload Aug 7 20:46:00.840387950 (11h6m0.429732927s) [upload=11575]: Done starting upload Aug 7 20:46:00.840431102 (11h6m0.429776079s) [upload=11575]: Uploading segments... Aug 7 20:46:00.840473594 (11h6m0.429818581s) [upload=11575]: Got next segment. Inline: true Aug 7 20:46:00.840477311 (11h6m0.429822298s) [upload=11575]: Waiting for error group managing segments... Aug 7 20:46:00.840510584 (11h6m0.429855571s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:00.840514551 (11h6m0.429859539s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:00.840516746 (11h6m0.429861733s) [upload=11575]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:01.149526394 (11h6m0.738871381s) [upload=11575]: Done uploading segments... Aug 7 20:46:01.149544077 (11h6m0.738889064s) [upload=11575]: Upload finished. err: <nil> Aug 7 20:46:32.531571609 (11h6m32.120916586s) [upload=11585]: Starting upload Aug 7 20:46:32.531627656 (11h6m32.120972643s) [upload=11585]: Done starting upload Aug 7 20:46:32.531679334 (11h6m32.121024311s) [upload=11585]: Uploading segments... Aug 7 20:46:32.531716416 (11h6m32.121061403s) [upload=11585]: Got next segment. Inline: true Aug 7 20:46:32.531720834 (11h6m32.121065821s) [upload=11585]: Waiting for error group managing segments... Aug 7 20:46:32.531758977 (11h6m32.121103964s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:32.531762984 (11h6m32.121107961s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:32.531766161 (11h6m32.121111148s) [upload=11585]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:32.823368074 (11h6m32.412713051s) [upload=11585]: Done uploading segments... Aug 7 20:46:32.823385747 (11h6m32.412730724s) [upload=11585]: Upload finished. err: <nil> Aug 7 20:46:53.991475826 (11h6m53.580820813s) [upload=11590]: Starting upload Aug 7 20:46:53.991528908 (11h6m53.580873895s) [upload=11590]: Done starting upload Aug 7 20:46:53.991580286 (11h6m53.580925273s) [upload=11590]: Uploading segments... Aug 7 20:46:53.991609822 (11h6m53.58095481s) [upload=11590]: Got next segment. Inline: true Aug 7 20:46:53.991613780 (11h6m53.580958767s) [upload=11590]: Waiting for error group managing segments... Aug 7 20:46:53.991645681 (11h6m53.580990668s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:46:53.991649578 (11h6m53.580994565s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:46:53.991651822 (11h6m53.580996809s) [upload=11590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:46:54.273031788 (11h6m53.862376835s) [upload=11590]: Done uploading segments... Aug 7 20:46:54.273056015 (11h6m53.862401032s) [upload=11590]: Upload finished. err: <nil> Aug 7 20:48:05.936480351 (11h8m5.525825338s) [upload=11610]: Starting upload Aug 7 20:48:05.936525999 (11h8m5.525870986s) [upload=11610]: Done starting upload Aug 7 20:48:05.936586324 (11h8m5.525931311s) [upload=11610]: Uploading segments... Aug 7 20:48:05.936615510 (11h8m5.525960487s) [upload=11610]: Got next segment. Inline: true Aug 7 20:48:05.936618666 (11h8m5.525963653s) [upload=11610]: Waiting for error group managing segments... Aug 7 20:48:05.936688099 (11h8m5.526033086s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:48:05.936692588 (11h8m5.526037575s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:48:05.936694892 (11h8m5.526039879s) [upload=11610]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:48:06.223792648 (11h8m5.813137635s) [upload=11610]: Done uploading segments... Aug 7 20:48:06.223807756 (11h8m5.813152743s) [upload=11610]: Upload finished. err: <nil> Aug 7 20:49:00.370365369 (11h8m59.959710356s) [upload=11624]: Starting upload Aug 7 20:49:00.370414633 (11h8m59.95975962s) [upload=11624]: Done starting upload Aug 7 20:49:00.370467765 (11h8m59.959812752s) [upload=11624]: Uploading segments... Aug 7 20:49:00.370501249 (11h8m59.959846236s) [upload=11624]: Got next segment. Inline: true Aug 7 20:49:00.370504986 (11h8m59.959849973s) [upload=11624]: Waiting for error group managing segments... Aug 7 20:49:00.370538900 (11h8m59.959883887s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:00.370542898 (11h8m59.959887885s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:00.370545453 (11h8m59.95989043s) [upload=11624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:00.736326238 (11h9m0.325671225s) [upload=11624]: Done uploading segments... Aug 7 20:49:00.736343821 (11h9m0.325688808s) [upload=11624]: Upload finished. err: <nil> Aug 7 20:49:43.904464651 (11h9m43.493809639s) [upload=11637]: Starting upload Aug 7 20:49:43.904540737 (11h9m43.493885724s) [upload=11637]: Done starting upload Aug 7 20:49:43.904599109 (11h9m43.493944096s) [upload=11637]: Uploading segments... Aug 7 20:49:43.904635608 (11h9m43.493980595s) [upload=11637]: Got next segment. Inline: true Aug 7 20:49:43.904639476 (11h9m43.493984463s) [upload=11637]: Waiting for error group managing segments... Aug 7 20:49:43.904675195 (11h9m43.494020182s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:49:43.904679252 (11h9m43.494024239s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:49:43.904683430 (11h9m43.494028417s) [upload=11637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:49:44.269042214 (11h9m43.858387201s) [upload=11637]: Done uploading segments... Aug 7 20:49:44.269058595 (11h9m43.858403582s) [upload=11637]: Upload finished. err: <nil> Aug 7 20:50:51.186360319 (11h10m50.775705306s) [upload=11656]: Starting upload Aug 7 20:50:51.186464308 (11h10m50.775809295s) [upload=11656]: Done starting upload Aug 7 20:50:51.186527319 (11h10m50.775872306s) [upload=11656]: Uploading segments... Aug 7 20:50:51.186558759 (11h10m50.775903746s) [upload=11656]: Got next segment. Inline: true Aug 7 20:50:51.186562295 (11h10m50.775907282s) [upload=11656]: Waiting for error group managing segments... Aug 7 20:50:51.186595108 (11h10m50.775940095s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:50:51.186599105 (11h10m50.775944082s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:50:51.186601591 (11h10m50.775946578s) [upload=11656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:50:51.466357188 (11h10m51.055702175s) [upload=11656]: Done uploading segments... Aug 7 20:50:51.466375784 (11h10m51.055720781s) [upload=11656]: Upload finished. err: <nil> Aug 7 20:51:54.183767656 (11h11m53.773112643s) [upload=11674]: Starting upload Aug 7 20:51:54.183810869 (11h11m53.773155846s) [upload=11674]: Done starting upload Aug 7 20:51:54.183850504 (11h11m53.773195481s) [upload=11674]: Uploading segments... Aug 7 20:51:54.183877035 (11h11m53.773222012s) [upload=11674]: Got next segment. Inline: true Aug 7 20:51:54.183880662 (11h11m53.773225639s) [upload=11674]: Waiting for error group managing segments... Aug 7 20:51:54.183910529 (11h11m53.773255516s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 20:51:54.183914426 (11h11m53.773259413s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 20:51:54.183916961 (11h11m53.773261938s) [upload=11674]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 20:51:54.662596438 (11h11m54.251941425s) [upload=11674]: Done uploading segments... Aug 7 20:51:54.662619702 (11h11m54.251964689s) [upload=11674]: Upload finished. err: <nil>
Duration: 1.932718865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|