Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..X....X..................X............X.....X.........] duration:
2.088477004s
FAIL (2025-08-23 13:54:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.088500077s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X....X..................X............X.....X........] duration:
2.064314672s
FAIL (2025-08-23 13:53:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.064338517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X..X...X......................] duration:
6.012910726s
FAIL (2025-08-23 13:53:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.012932297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X..X...X.....................] duration:
5.987522043s
FAIL (2025-08-23 13:53:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 5.987547803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..X....X..................X............X.....X.......] duration:
2.495465617s
FAIL (2025-08-23 13:53:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.495497898s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X..X...X....................] duration:
6.358738625s
FAIL (2025-08-23 13:52:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.358765497s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..X....X..................X............X.....X......] duration:
2.011399613s
FAIL (2025-08-23 13:52:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.011424741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..X....X..................X............X.....X.....] duration:
1.868000312s
FAIL (2025-08-23 13:52:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 1.868036832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X..X....X..................X............X.....X....] duration:
2.034911211s
FAIL (2025-08-23 13:51:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.034940116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X..X...X...................] duration:
6.559025023s
FAIL (2025-08-23 13:51:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.559051595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X..X....X..................X............X.....X...] duration:
2.15990827s
FAIL (2025-08-23 13:51:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 2.159943318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X..X...X..................] duration:
6.056379695s
FAIL (2025-08-23 13:51:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.056409403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X..X...X.................] duration:
6.015932567s
FAIL (2025-08-23 13:50:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.015958606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X..X....X..................X............X.....X..] duration:
1.854543814s
FAIL (2025-08-23 13:50:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 1.85458876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................X..X...X................] duration:
6.784333218s
FAIL (2025-08-23 13:49:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.784361132s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X..X....X..................X............X.....X.] duration:
1.97085289s
FAIL (2025-08-23 13:49:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 1.970872157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X..X...X...............] duration:
6.047389467s
FAIL (2025-08-23 13:48:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.047411238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X..X....X..................X............X.....X] duration:
1.491374213s
FAIL (2025-08-23 13:48:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 13:48:10.753717490 (356h22m5.184797661s) [upload=370689]: Starting upload Aug 23 13:48:10.753817732 (356h22m5.184897864s) [upload=370689]: Done starting upload Aug 23 13:48:10.753873028 (356h22m5.184953159s) [upload=370689]: Uploading segments... Aug 23 13:48:10.753908666 (356h22m5.184988797s) [upload=370689]: Got next segment. Inline: true Aug 23 13:48:10.753912343 (356h22m5.184992474s) [upload=370689]: Waiting for error group managing segments... Aug 23 13:48:10.753947060 (356h22m5.185027191s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:48:10.753951238 (356h22m5.185031369s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:48:10.753953753 (356h22m5.185033884s) [upload=370689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:48:11.129114428 (356h22m5.560194599s) [upload=370689]: Done uploading segments... Aug 23 13:48:11.129137421 (356h22m5.560217552s) [upload=370689]: Upload finished. err: <nil>
Duration: 1.491404782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................................X..X...X..............] duration:
6.008851609s
FAIL (2025-08-23 13:47:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.00888292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X..X....X..................X............X.....] duration:
2.212241695s
FAIL (2025-08-23 13:47:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.212266724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................................X..X...X.............] duration:
6.407347783s
FAIL (2025-08-23 13:46:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.407376228s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X..X....X..................X............X....] duration:
2.162621521s
FAIL (2025-08-23 13:45:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.162646539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.......................................X..X...X............] duration:
5.968296199s
FAIL (2025-08-23 13:45:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 5.968325135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [................X..X....X..................X............X...] duration:
2.117852086s
FAIL (2025-08-23 13:45:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.117881783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.......................................X..X...X...........] duration:
5.991617105s
FAIL (2025-08-23 13:44:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 5.991645048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.................X..X....X..................X............X..] duration:
2.037861913s
FAIL (2025-08-23 13:44:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.037886541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.......................................X..X...X..........] duration:
6.209557832s
FAIL (2025-08-23 13:44:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.209588811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..................X..X....X..................X............X.] duration:
1.833823325s
FAIL (2025-08-23 13:43:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833848263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...................X..X....X..................X............X] duration:
881.198014ms
FAIL (2025-08-23 13:43:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 13:43:26.051007035 (356h17m20.482087166s) [upload=370612]: Starting upload Aug 23 13:43:26.051056510 (356h17m20.482136641s) [upload=370612]: Done starting upload Aug 23 13:43:26.051103419 (356h17m20.48218355s) [upload=370612]: Uploading segments... Aug 23 13:43:26.051138217 (356h17m20.482218348s) [upload=370612]: Got next segment. Inline: true Aug 23 13:43:26.051142104 (356h17m20.482222235s) [upload=370612]: Waiting for error group managing segments... Aug 23 13:43:26.051172622 (356h17m20.482252753s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:43:26.051176409 (356h17m20.48225654s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:43:26.051179225 (356h17m20.482259356s) [upload=370612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:43:26.272226854 (356h17m20.703306985s) [upload=370612]: Done uploading segments... Aug 23 13:43:26.272242845 (356h17m20.703322976s) [upload=370612]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.221761ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.......................................X..X...X.........] duration:
5.907114028s
FAIL (2025-08-23 13:42:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 5.907130158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X..X....X..................X............] duration:
1.879153502s
FAIL (2025-08-23 13:42:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.879182117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..X....X..................X...........] duration:
2.305015201s
FAIL (2025-08-23 13:42:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 2.305045819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.......................................X..X...X........] duration:
6.057490197s
FAIL (2025-08-23 13:41:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.057516738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......................................X..X...X.......] duration:
6.073469159s
FAIL (2025-08-23 13:41:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.073497163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X..X....X..................X..........] duration:
1.999948151s
FAIL (2025-08-23 13:41:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.999972717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X..X....X..................X.........] duration:
1.946116177s
FAIL (2025-08-23 13:40:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.946147668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.......................................X..X...X......] duration:
6.197243542s
FAIL (2025-08-23 13:40:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.197268811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X..X....X..................X........] duration:
1.894839925s
FAIL (2025-08-23 13:40:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.89487411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.......................................X..X...X.....] duration:
6.089907315s
FAIL (2025-08-23 13:39:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.089934076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X..X....X..................X.......] duration:
1.931792601s
FAIL (2025-08-23 13:39:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.931827175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.......................................X..X...X....] duration:
6.102809129s
FAIL (2025-08-23 13:38:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.102836391s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X..X....X..................X......] duration:
1.924305405s
FAIL (2025-08-23 13:38:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.924330182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X..X....X..................X.....] duration:
1.87483675s
FAIL (2025-08-23 13:38:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 1.874873571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.......................................X..X...X...] duration:
6.226093392s
FAIL (2025-08-23 13:37:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.226122207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X.......................................X..X...X..] duration:
5.963636348s
FAIL (2025-08-23 13:37:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 5.963663731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X..X....X..................X....] duration:
2.294640424s
FAIL (2025-08-23 13:37:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 2.294670492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X.......................................X..X...X.] duration:
6.373055991s
FAIL (2025-08-23 13:36:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 6.373083152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X..X....X..................X...] duration:
2.022137195s
FAIL (2025-08-23 13:36:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59c802ecac54dd2a650b1a10535116a0a1f8ee098ac581dc65c7693cad3ec52e != before e24ffb5ff2fb4fb992922a15073ad82faced1c33f5238a5351d08a3b1cd151b4 ======LOGS====== Aug 23 13:33:50.293978111 (356h7m44.725058242s) [upload=370445]: Starting upload Aug 23 13:33:50.294029349 (356h7m44.72510948s) [upload=370445]: Done starting upload Aug 23 13:33:50.294136905 (356h7m44.725217026s) [upload=370445]: Uploading segments... Aug 23 13:33:50.294175188 (356h7m44.725255319s) [upload=370445]: Got next segment. Inline: true Aug 23 13:33:50.294179155 (356h7m44.725259286s) [upload=370445]: Waiting for error group managing segments... Aug 23 13:33:50.294213902 (356h7m44.725294033s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 13:33:50.294217980 (356h7m44.725298111s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 13:33:50.294220515 (356h7m44.725300646s) [upload=370445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 13:33:50.607891442 (356h7m45.038971573s) [upload=370445]: Done uploading segments... Aug 23 13:33:50.607907052 (356h7m45.038987183s) [upload=370445]: Upload finished. err: <nil>
Duration: 2.022164446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X.......................................X..X...X] duration:
4.127572797s
FAIL (2025-08-23 13:36:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:36:16.053370685 (356h10m10.484450826s) [upload=370483]: Starting upload
Aug 23 13:36:16.053452661 (356h10m10.484532822s) [upload=370483]: Done starting upload
Aug 23 13:36:16.053636373 (356h10m10.484716554s) [upload=370483]: Uploading segments...
Aug 23 13:36:16.053841816 (356h10m10.484921947s) [upload=370483]: Got next segment. Inline: false
Aug 23 13:36:16.053899636 (356h10m10.484979797s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:36:16.053907212 (356h10m10.484987373s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:36:16.503637724 (356h10m10.934717855s) [seg_pos={0 0}, upload=370483]: Begin upload segment...
Aug 23 13:36:16.503682370 (356h10m10.934762501s) [seg_pos={0 0}, upload=370483]: Done begin upload segment.
Aug 23 13:36:16.503703459 (356h10m10.93478359s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.503736724 (356h10m10.934816855s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504054060 (356h10m10.935134191s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504262439 (356h10m10.93534257s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504460258 (356h10m10.935540389s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504731567 (356h10m10.935811698s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.504789197 (356h10m10.935869328s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505002445 (356h10m10.936082576s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505259196 (356h10m10.936339327s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505317498 (356h10m10.936397639s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505517341 (356h10m10.936597472s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.505730077 (356h10m10.936810208s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506125564 (356h10m10.937205695s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506525068 (356h10m10.937605209s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.506910385 (356h10m10.937990516s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.509008621 (356h10m10.940088752s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510126570 (356h10m10.941206701s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:16.510456271 (356h10m10.941536572s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Uploading piece...
Aug 23 13:36:17.649470992 (356h10m12.080551113s) [upload=370483]: Next returned nil segment
Aug 23 13:36:17.649485941 (356h10m12.080566062s) [upload=370483]: Waiting for error group managing segments...
Aug 23 13:36:17.936765972 (356h10m12.367846103s) [noise=true , address=79.127.205.233:4644 , piece_id=OQMWEQOYGRTXTIAXXJP45KUDNSRRDM7JO5DFYZWUX2J4E4I3SH2Q, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.384933305 (356h10m12.816013436s) [noise=true , address=79.127.219.47:4068 , piece_id=UGATFMRNXE4PJDECLMBBPPWLNTFJ25P67P2KCKJOFQA4LHIUGDLA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.429420276 (356h10m12.860500407s) [noise=true , address=79.127.219.51:4215 , piece_id=2GHJ27ZI73CCRX36GH23ZVB35FFXKIDXXA2ZGASFZHPL76DNVUCQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.498513159 (356h10m12.92959329s) [noise=true , address=79.127.201.215:4351 , piece_id=SRG7RNQTI7ZBV4TBAAQHMW2SZ2MUGFAXNB5UJQS5CG4UAEFXU3VQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.520692937 (356h10m12.951773069s) [noise=true , address=104.36.82.23:4474 , piece_id=NWK3WHJIBVTJNXS7763QO5DGB4QBPJBRFPK73OUYPPHRKO4OVOBQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.548737969 (356h10m12.97981811s) [noise=true , address=45.91.116.6:4986 , piece_id=CXFQ6I2FBWOO2LBVYWENAVAYMVUGELWN3RPP6O3M2U2HM3IVS3BQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.572273902 (356h10m13.003354033s) [noise=true , address=104.36.82.49:4001 , piece_id=42A7JNGIATV5YWPFKMCUONACHQZHNKFAFGFWNNRRPGVATMI5FT3A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.574303806 (356h10m13.005383937s) [noise=true , address=104.36.82.39:4735 , piece_id=D3SYKEIW6OSM6LN7ZKCSDC5EZ74DI4MYVH7ENBPFPE6HUGHWOHTA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.602547678 (356h10m13.033627809s) [noise=true , address=77.90.31.13:4650 , piece_id=IJ6MZCCFFXZZZKGZBIHWR2QCV76VDE3BSD42ZTTEWH4ZAUDDRAQA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.637112275 (356h10m13.068192416s) [noise=true , address=104.36.82.38:4716 , piece_id=5FBJD7IEMZF2V77LHTFCMDUGIB5GXPRMYAYVJP5WNVAG6GFTOD7A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.646836371 (356h10m13.077916502s) [noise=true , address=104.36.82.60:4352 , piece_id=RKVQB27MUTWFIIKQ6SVRQ5IECIB2D3IRAS4KBE53T2U3UVUD7N2A, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.651242761 (356h10m13.082322893s) [noise=true , address=77.90.31.21:4886 , piece_id=XAFPSCSMJJTDLKOQNP6XIXLRZMZ7WJZ77YHVEYSYIH4HIP2MBNUA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.653235926 (356h10m13.084316057s) [noise=true , address=77.90.31.10:4551 , piece_id=TQTHHWQWBI2W3H5QAHKWL7VAHZP66UDV7XTH5GJC6GP6QOPIS4OA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769432245 (356h10m13.200512376s) [noise=true , address=104.36.82.5:4866 , piece_id=K7KM4I2ERYTKMOWGHCI3TY6MFKZMVSZDYT6XKJOTGQ6S5O7JP6YA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: <nil>
Aug 23 13:36:18.769459357 (356h10m13.200539488s) [seg_pos={0 0}, upload=370483]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:36:18.769571291 (356h10m13.200651422s) [noise=true , address=77.90.31.16:4752 , piece_id=5JGYKOXML25JMR2XP3LGA5JK325Z5HY5AQF3ZHST6PA75CXLRTFQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769638210 (356h10m13.200718341s) [noise=true , address=104.36.82.9:4017 , piece_id=IA5CVVWA5B7I6WHR67UETPEOHW7LKW4LAPDNUVKWAWBR5VIWHZOQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wS9YpUnsjgkdTPSowozp8txmqAhfF4n8s7JVpLb2tdRgQeLw8): protocol: expected piece hash; context canceled; EOF
Aug 23 13:36:18.769830638 (356h10m13.200910769s) [noise=true , address=77.90.31.15:4705 , piece_id=VA7QVGUYIQD7DNQ7PUITOP75PZWDJHTMSESHQ5YOSIPKB5GSTTWA, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h41MzKfNcdZxHpUtH1MiybVcSxAYPNNwnmSELZieiUW2fY2kw): protocol: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35826->77.90.31.15:4705: use of closed network connection
Aug 23 13:36:18.769851136 (356h10m13.200931267s) [noise=true , address=45.91.116.11:4124 , piece_id=K4PF6L4XKHKDASN252GSM6SJZ5AECMOICXAT2DIGROKQJV5SLISQ, seg_pos={0 0}, upload=370483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSQgozKbq7XjSYP5dUJjkrnTkWX4EFgBkruqUmdV3ehnoPfkr): protocol: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55802->45.91.116.11:4124: use of closed network connection
Aug 23 13:36:18.769882707 (356h10m13.200962839s) [seg_pos={0 0}, upload=370483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:36:18.770000332 (356h10m13.201080463s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:36:18.770007285 (356h10m13.201087416s) [upload=370483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:36:19.090914679 (356h10m13.521994851s) [upload=370483]: Done uploading segments...
Aug 23 13:36:19.090935509 (356h10m13.522015641s) [upload=370483]: Upload finished. err: <nil>
Duration: 4.127605749s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......................................X..X...] duration:
6.589276083s
FAIL (2025-08-23 13:36:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 13:34:08.423873421 (356h8m2.854953552s) [upload=370448]: Starting upload
Aug 23 13:34:08.423947361 (356h8m2.855027492s) [upload=370448]: Done starting upload
Aug 23 13:34:08.424072952 (356h8m2.855153083s) [upload=370448]: Uploading segments...
Aug 23 13:34:08.424154909 (356h8m2.85523504s) [upload=370448]: Got next segment. Inline: false
Aug 23 13:34:08.424215124 (356h8m2.855295255s) [upload=370448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 13:34:08.424222167 (356h8m2.855302308s) [upload=370448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 13:34:08.893318116 (356h8m3.324398247s) [seg_pos={0 0}, upload=370448]: Begin upload segment...
Aug 23 13:34:08.893427936 (356h8m3.324508067s) [seg_pos={0 0}, upload=370448]: Done begin upload segment.
Aug 23 13:34:08.893461360 (356h8m3.324541491s) [noise=true , address=104.36.82.60:4351 , piece_id=23YZW6VBM7XOA4AK5IFELPIGRQQWONLRRLPBTXB4UX57XCBEXYMA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.893507408 (356h8m3.324587539s) [noise=true , address=77.90.31.10:4532 , piece_id=T3HUQZMLCWKVZJOB4SQ4GTGIVFFNGJLGTZM7E3D2WWY2LAHHXBCA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.894233156 (356h8m3.325313287s) [noise=true , address=104.36.82.2:4759 , piece_id=W2GIUQE33OPBNGF7UTMQD77B7FITPE5BWIBI452YJNCCIZBPM4UQ, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.894593796 (356h8m3.325673987s) [noise=true , address=79.127.219.48:4077 , piece_id=BW7JVC4IGCIGKKXUHGTMISGXUVXHYAQ5YAXAMDNS37QMDU2HV6HA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.894727041 (356h8m3.325807172s) [noise=true , address=77.90.31.13:4644 , piece_id=GSIESNGYN3NYQ7Y2MYRJRRGNN3UMCEGWZSSU2E6WZVHGLPTVPFAA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895064667 (356h8m3.326144798s) [noise=true , address=79.127.219.51:4207 , piece_id=RIB4DBZ6FGSULY4SYX6H5XSHHPRT3T4X6BEYPKOQOFY6KLXVIM7A, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895335596 (356h8m3.326415747s) [noise=true , address=79.127.201.215:4353 , piece_id=XC6KKCSE25Q34AXBKU724BP3H4X2UXGYS7B7X2O5QLEITDQLDNTA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895429897 (356h8m3.326510028s) [noise=true , address=104.36.82.23:4460 , piece_id=VRBAXLETVFRACTM7XARY65RTZIYRGBUCGWBZHWEPIYBA534BCIYA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895690485 (356h8m3.326770616s) [noise=true , address=79.127.219.47:4072 , piece_id=RI4CKCXTPLJQ66PP2PF6UMDUDWBX22KUOJ64GZ7KWYCJK65SR3UA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895908883 (356h8m3.326989014s) [noise=true , address=77.90.31.12:4596 , piece_id=5LKV4JFVVZYGSKPXV4C3FV2EZWZP2J4DWNO2QIRNUL6HPGTXYYUA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.895925535 (356h8m3.327005666s) [noise=true , address=104.36.82.44:4892 , piece_id=HKH5BTEJWFDIVQQ7FSEXQR23TN3ML4QILABETIPJDUPQRZNZBZIA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.896137220 (356h8m3.327217351s) [noise=true , address=104.36.82.55:4227 , piece_id=2CMMZH55J2AOOJD45MJAOATIB56C3GX2MEN2LWJNEHNSPQCO54FQ, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.896461570 (356h8m3.327541701s) [noise=true , address=79.127.205.246:4279 , piece_id=GIQVBC5EWGNJNWPNFRSFGMWYQRV7WJL5JRZZ6BQSZ7PTJCNKKC7Q, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.896727810 (356h8m3.327807941s) [noise=true , address=77.90.31.19:4859 , piece_id=M2LUSFL5FZEKPTFBANLRAMBZAZD26B6MYKBFHQK36HYCKS7TE2GA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.896941178 (356h8m3.328021309s) [noise=true , address=79.127.205.233:4644 , piece_id=576YJCTSOS7VKRZWF2ZBXTMW5CKJ5Q4QII7K5N2ZB7R5BMOT6O7A, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.897179334 (356h8m3.328259465s) [noise=true , address=104.36.82.5:4872 , piece_id=JKKOW33J56BR6XD7KKB4P6BEY23Q5RQ4CC7U4C6HNSZ6LMDT4VZA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.897509957 (356h8m3.328590088s) [noise=true , address=104.36.82.13:4212 , piece_id=KZNN4A2WOS3ULZOE4PHWNGQGN6LUIVHYHP43LTOMUIUMOSSDNT2Q, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:08.897551476 (356h8m3.328631617s) [noise=true , address=104.36.82.11:4121 , piece_id=ZOJKL7ZS2DTKC33JXBGJVJGUQE55RMDGYTKGL4MCDTPNB6L55PFA, seg_pos={0 0}, upload=370448]: Uploading piece...
Aug 23 13:34:10.025374892 (356h8m4.456455023s) [upload=370448]: Next returned nil segment
Aug 23 13:34:10.025392496 (356h8m4.456472627s) [upload=370448]: Waiting for error group managing segments...
Aug 23 13:34:10.344331593 (356h8m4.775411724s) [noise=true , address=79.127.205.233:4644 , piece_id=576YJCTSOS7VKRZWF2ZBXTMW5CKJ5Q4QII7K5N2ZB7R5BMOT6O7A, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.348630960 (356h8m4.779711091s) [noise=true , address=79.127.205.246:4279 , piece_id=GIQVBC5EWGNJNWPNFRSFGMWYQRV7WJL5JRZZ6BQSZ7PTJCNKKC7Q, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.785228035 (356h8m5.216308166s) [noise=true , address=79.127.219.47:4072 , piece_id=RI4CKCXTPLJQ66PP2PF6UMDUDWBX22KUOJ64GZ7KWYCJK65SR3UA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.811321782 (356h8m5.242401913s) [noise=true , address=104.36.82.55:4227 , piece_id=2CMMZH55J2AOOJD45MJAOATIB56C3GX2MEN2LWJNEHNSPQCO54FQ, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.834503007 (356h8m5.265583138s) [noise=true , address=77.90.31.19:4859 , piece_id=M2LUSFL5FZEKPTFBANLRAMBZAZD26B6MYKBFHQK36HYCKS7TE2GA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.863384870 (356h8m5.294465001s) [noise=true , address=79.127.219.51:4207 , piece_id=RIB4DBZ6FGSULY4SYX6H5XSHHPRT3T4X6BEYPKOQOFY6KLXVIM7A, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.871543660 (356h8m5.302623791s) [noise=true , address=79.127.219.48:4077 , piece_id=BW7JVC4IGCIGKKXUHGTMISGXUVXHYAQ5YAXAMDNS37QMDU2HV6HA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.887505091 (356h8m5.318585222s) [noise=true , address=104.36.82.11:4121 , piece_id=ZOJKL7ZS2DTKC33JXBGJVJGUQE55RMDGYTKGL4MCDTPNB6L55PFA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.903282269 (356h8m5.3343624s) [noise=true , address=104.36.82.2:4759 , piece_id=W2GIUQE33OPBNGF7UTMQD77B7FITPE5BWIBI452YJNCCIZBPM4UQ, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.916420797 (356h8m5.347500968s) [noise=true , address=79.127.201.215:4353 , piece_id=XC6KKCSE25Q34AXBKU724BP3H4X2UXGYS7B7X2O5QLEITDQLDNTA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.926809986 (356h8m5.357890147s) [noise=true , address=77.90.31.10:4532 , piece_id=T3HUQZMLCWKVZJOB4SQ4GTGIVFFNGJLGTZM7E3D2WWY2LAHHXBCA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.954233318 (356h8m5.385313449s) [noise=true , address=104.36.82.44:4892 , piece_id=HKH5BTEJWFDIVQQ7FSEXQR23TN3ML4QILABETIPJDUPQRZNZBZIA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:10.982383501 (356h8m5.413463632s) [noise=true , address=104.36.82.13:4212 , piece_id=KZNN4A2WOS3ULZOE4PHWNGQGN6LUIVHYHP43LTOMUIUMOSSDNT2Q, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:11.037412674 (356h8m5.468492805s) [noise=true , address=77.90.31.13:4644 , piece_id=GSIESNGYN3NYQ7Y2MYRJRRGNN3UMCEGWZSSU2E6WZVHGLPTVPFAA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: <nil>
Aug 23 13:34:11.037438964 (356h8m5.468519095s) [seg_pos={0 0}, upload=370448]: Segment reached optimal threshold of 14 pieces.
Aug 23 13:34:11.037568011 (356h8m5.468648142s) [noise=true , address=104.36.82.5:4872 , piece_id=JKKOW33J56BR6XD7KKB4P6BEY23Q5RQ4CC7U4C6HNSZ6LMDT4VZA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: expected piece hash; context canceled; EOF
Aug 23 13:34:11.037660548 (356h8m5.468740679s) [noise=true , address=77.90.31.12:4596 , piece_id=5LKV4JFVVZYGSKPXV4C3FV2EZWZP2J4DWNO2QIRNUL6HPGTXYYUA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf): protocol: expected piece hash; context canceled; EOF
Aug 23 13:34:11.037716295 (356h8m5.468796426s) [noise=true , address=104.36.82.60:4351 , piece_id=23YZW6VBM7XOA4AK5IFELPIGRQQWONLRRLPBTXB4UX57XCBEXYMA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 23 13:34:11.037867224 (356h8m5.468947355s) [noise=true , address=104.36.82.23:4460 , piece_id=VRBAXLETVFRACTM7XARY65RTZIYRGBUCGWBZHWEPIYBA534BCIYA, seg_pos={0 0}, upload=370448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn): protocol: read tcp 188.166.225.170:43508->104.36.82.23:4460: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 13:34:11.037901119 (356h8m5.46898124s) [seg_pos={0 0}, upload=370448]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 13:34:11.037966684 (356h8m5.469046815s) [upload=370448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 13:34:11.037970671 (356h8m5.469050792s) [upload=370448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 13:34:11.702580245 (356h8m6.133660377s) [upload=370448]: Done uploading segments...
Aug 23 13:34:11.702620191 (356h8m6.133700313s) [upload=370448]: Upload finished. err: <nil>
Duration: 6.589303246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|