Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.........X.X..............................X......] duration:
1.841785397s
FAIL (2025-08-15 01:39:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.841804503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.625367099s
FAIL (2025-08-15 01:38:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.625391014s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.........X.X..............................X.....] duration:
1.879179261s
FAIL (2025-08-15 01:38:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.879206924s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.........X.X..............................X....] duration:
1.844005635s
FAIL (2025-08-15 01:37:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.844031336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X........X..................................................] duration:
5.559294542s
FAIL (2025-08-15 01:37:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.559325102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X........X.................................................] duration:
5.630512818s
FAIL (2025-08-15 01:37:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.630539008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.........X.X..............................X...] duration:
1.870065087s
FAIL (2025-08-15 01:36:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.870100784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.X........X................................................] duration:
5.981880998s
FAIL (2025-08-15 01:36:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.981911846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.X........X...............................................] duration:
5.711791512s
FAIL (2025-08-15 01:36:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.711830046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.........X.X..............................X..] duration:
1.848620392s
FAIL (2025-08-15 01:35:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.848652394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.X........X..............................................] duration:
5.886760217s
FAIL (2025-08-15 01:35:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.886779775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..............X.........X.X..............................X.] duration:
2.035485037s
FAIL (2025-08-15 01:35:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 2.035505277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.X........X.............................................] duration:
5.966168455s
FAIL (2025-08-15 01:34:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.966190547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..............X.........X.X..............................X] duration:
1.658979066s
FAIL (2025-08-15 01:33:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4d6be6c1ff884f83a3d892a9b9a8ff81fb0b219a7cfd6dc11693f146ff18e625 != before fc630fa6a4b7dca39abe25f555aa1a5d792f74f5ab4ac6d514605bd684a53161 ======LOGS====== Aug 15 01:33:56.903003628 (152h7m51.334083759s) [upload=158237]: Starting upload Aug 15 01:33:56.903050037 (152h7m51.334130168s) [upload=158237]: Done starting upload Aug 15 01:33:56.903120842 (152h7m51.334200963s) [upload=158237]: Uploading segments... Aug 15 01:33:56.903177420 (152h7m51.334257551s) [upload=158237]: Got next segment. Inline: true Aug 15 01:33:56.903181599 (152h7m51.33426172s) [upload=158237]: Waiting for error group managing segments... Aug 15 01:33:56.903215143 (152h7m51.334295274s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:33:56.903219561 (152h7m51.334299692s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:33:56.903222477 (152h7m51.334302608s) [upload=158237]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:33:57.187174947 (152h7m51.618255068s) [upload=158237]: Done uploading segments... Aug 15 01:33:57.187194976 (152h7m51.618275107s) [upload=158237]: Upload finished. err: <nil>
Duration: 1.658994036s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.X........X............................................] duration:
5.634288747s
FAIL (2025-08-15 01:33:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.634311261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..............X.........X.X..............................] duration:
1.86605365s
FAIL (2025-08-15 01:33:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.866079658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X........X...........................................] duration:
5.704719862s
FAIL (2025-08-15 01:32:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.704742096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..............X.........X.X.............................] duration:
2.09017308s
FAIL (2025-08-15 01:32:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.090203568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..............X.........X.X............................] duration:
1.870182848s
FAIL (2025-08-15 01:31:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.870208537s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.X........X..........................................] duration:
5.854943711s
FAIL (2025-08-15 01:31:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.85496854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............X.........X.X...........................] duration:
1.855464008s
FAIL (2025-08-15 01:31:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855493112s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.X........X.........................................] duration:
5.765564776s
FAIL (2025-08-15 01:31:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.765594702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..............X.........X.X..........................] duration:
1.875381074s
FAIL (2025-08-15 01:30:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875412363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.X........X........................................] duration:
5.815285334s
FAIL (2025-08-15 01:30:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.815314649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..............X.........X.X.........................] duration:
1.830827592s
FAIL (2025-08-15 01:29:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.830854765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..............X.........X.X........................] duration:
1.816007046s
FAIL (2025-08-15 01:29:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.816031423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.X........X.......................................] duration:
5.748946602s
FAIL (2025-08-15 01:28:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.748972633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X..............X.........X.X.......................] duration:
1.8525227s
FAIL (2025-08-15 01:28:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.852562476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.X........X......................................] duration:
5.667687289s
FAIL (2025-08-15 01:28:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.667705955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X..............X.........X.X......................] duration:
1.974383212s
FAIL (2025-08-15 01:27:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.974412027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..............X.........X.X.....................] duration:
1.859764381s
FAIL (2025-08-15 01:27:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.859793808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.X........X.....................................] duration:
5.720231801s
FAIL (2025-08-15 01:26:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.720256639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X..............X.........X.X....................] duration:
1.840846131s
FAIL (2025-08-15 01:26:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840869395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.X........X....................................] duration:
5.781660911s
FAIL (2025-08-15 01:26:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.781684096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X..............X.........X.X...................] duration:
2.00864113s
FAIL (2025-08-15 01:26:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.008668933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.X........X...................................] duration:
5.76629456s
FAIL (2025-08-15 01:25:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.766317884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X..............X.........X.X..................] duration:
1.858618219s
FAIL (2025-08-15 01:25:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.858653246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X..............X.........X.X.................] duration:
1.878226094s
FAIL (2025-08-15 01:24:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878265642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.X........X..................................] duration:
5.493896365s
FAIL (2025-08-15 01:24:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.493920261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X..............X.........X.X................] duration:
1.85469377s
FAIL (2025-08-15 01:23:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854720562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.X........X.................................] duration:
5.67857628s
FAIL (2025-08-15 01:23:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.678596169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X..............X.........X.X...............] duration:
1.838372832s
FAIL (2025-08-15 01:22:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838396977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.X........X................................] duration:
5.857297266s
FAIL (2025-08-15 01:22:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.857323305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X..............X.........X.X..............] duration:
1.824637341s
FAIL (2025-08-15 01:21:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824660346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.X........X...............................] duration:
5.961846506s
FAIL (2025-08-15 01:21:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.961875261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X..............X.........X.X.............] duration:
1.854086361s
FAIL (2025-08-15 01:21:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854112502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.X........X..............................] duration:
5.668761249s
FAIL (2025-08-15 01:20:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.668787279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X..............X.........X.X............] duration:
1.835906113s
FAIL (2025-08-15 01:20:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.835928114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..................X.X........X.............................] duration:
5.681446678s
FAIL (2025-08-15 01:20:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 00:58:32.581222879 (151h32m27.01230301s) [upload=157620]: Starting upload
Aug 15 00:58:32.581269818 (151h32m27.012349949s) [upload=157620]: Done starting upload
Aug 15 00:58:32.581396140 (151h32m27.012476261s) [upload=157620]: Uploading segments...
Aug 15 00:58:32.581485000 (151h32m27.012565131s) [upload=157620]: Got next segment. Inline: false
Aug 15 00:58:32.581512833 (151h32m27.012592954s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 00:58:32.581517301 (151h32m27.012597432s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 00:58:33.058454022 (151h32m27.489534153s) [seg_pos={0 0}, upload=157620]: Begin upload segment...
Aug 15 00:58:33.058497686 (151h32m27.489577807s) [seg_pos={0 0}, upload=157620]: Done begin upload segment.
Aug 15 00:58:33.058511141 (151h32m27.489591272s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058519858 (151h32m27.489599989s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058560435 (151h32m27.489640557s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058852034 (151h32m27.489932165s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.058860289 (151h32m27.48994041s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059103425 (151h32m27.490183556s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059349626 (151h32m27.490429757s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.059642617 (151h32m27.490722778s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060060256 (151h32m27.491140407s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060338468 (151h32m27.491418589s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060585921 (151h32m27.491666052s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.060820601 (151h32m27.491900732s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061008760 (151h32m27.492088891s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061207551 (151h32m27.492287682s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061432521 (151h32m27.492512652s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061676809 (151h32m27.49275695s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.061898503 (151h32m27.492978634s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:33.062112272 (151h32m27.493192403s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Uploading piece...
Aug 15 00:58:34.233942354 (151h32m28.665022486s) [upload=157620]: Next returned nil segment
Aug 15 00:58:34.233960469 (151h32m28.665040601s) [upload=157620]: Waiting for error group managing segments...
Aug 15 00:58:34.594670563 (151h32m29.025750685s) [noise=true , address=79.127.205.246:4257 , piece_id=WIASOY72SN5SAUG4YGJSQOTIIL6CVSEF5XEDLSUD3KDLAVJ3NP6A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.973434482 (151h32m29.404514613s) [noise=true , address=77.90.31.10:4528 , piece_id=4YT4VVUWQHSC6ERJVNHWZAO3CLATDEVM7FKW6D5PNLDHIWZXGWQA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.978691621 (151h32m29.409771742s) [noise=true , address=104.36.82.18:4398 , piece_id=ZZBVVH7LV6FAP2YJHCH7YQ4JKOOPXYKA6F7GOJKXFBOV33JIVATA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.980709392 (151h32m29.411789523s) [noise=true , address=77.90.31.16:4738 , piece_id=KSEBMQZ5FPBLXGPE5ORR5VXWDA67ZA6L37L5E7OJGZK5WDCREOXA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:34.988240282 (151h32m29.419320413s) [noise=true , address=104.36.82.50:4030 , piece_id=DVBUSCSDULRFWXIUKOEKDU3AI2CZTPLY2ASEUYC4EEGFLOTWZEAQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.003493927 (151h32m29.434574058s) [noise=true , address=104.36.82.37:4679 , piece_id=I76OHB7J337QMSCOV6PXW4ARWW4TTIE3ZJRDYZ4HKFJA7BQFE7TQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.019741335 (151h32m29.450821456s) [noise=true , address=77.90.31.12:4597 , piece_id=RSH6YC4LP7DP3FZPSZ4IYMWMLK6ZVIQL6JX67ZGUNUB7FVTV22AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.023212266 (151h32m29.454292397s) [noise=true , address=104.36.82.51:4049 , piece_id=JYFJ2VZNLRCG5ELJCVEKUGVQALQ7AD45B4TQFKTQ7THGGIW6PTYQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.030529126 (151h32m29.461609257s) [noise=true , address=104.36.82.58:4282 , piece_id=GKJVRNG7F3C2N5SGZ7CWC6CXDZQJMFBHYYP536VR5JIFUOLVO2BQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.035626038 (151h32m29.466706159s) [noise=true , address=104.36.82.39:4729 , piece_id=GXWYJUOQRCANBBFFORF3UUXZGCONXX7BNET3HJJ4PAL2UGWOG2MQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.048907610 (151h32m29.479987741s) [noise=true , address=45.91.116.13:4165 , piece_id=I3KMXGECLFMRKIWBTWJMKZ7AZOM6WYL4MEHV3KEKTNVS5OSLADOQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.061762377 (151h32m29.492842508s) [noise=true , address=104.36.82.60:4355 , piece_id=5M3J5JIGDX4JUVRRPGZR3T5M6Z4NPHCQUQGAYK5F4JXEW2VGF3QA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.113854068 (151h32m29.544934199s) [noise=true , address=104.36.82.8:4999 , piece_id=HMBVY2EDLQO7OS66HYZBVJE4OHVHHYTOODXYRDPT5HRBG3YAO4AA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127320283 (151h32m29.558400414s) [noise=true , address=77.90.31.21:4893 , piece_id=OHQ2KMPWNMG6ZOJWZFAIKAGK5XCPFIL23PRUFRC5YO4VJSYI5G3A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: <nil>
Aug 15 00:58:35.127339530 (151h32m29.558419662s) [seg_pos={0 0}, upload=157620]: Segment reached optimal threshold of 14 pieces.
Aug 15 00:58:35.127493976 (151h32m29.558574097s) [noise=true , address=104.36.82.19:4425 , piece_id=COHWKDPGND7ECWXLZUG3VHPCBKRIRNMFK44FUAM4F7DVTSHZ2CYA, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127547619 (151h32m29.55862775s) [noise=true , address=104.36.82.59:4307 , piece_id=MVDDXMDWASWVL76F4A4YVD3IH5KTH3FIQFGUPTM2BXUZ4U7QUGCQ, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127573228 (151h32m29.558653359s) [noise=true , address=104.36.82.35:4604 , piece_id=PO3WYHAKACHHXOVLR4DDBICMZJ5KZJSFMRZVOAZH4XZY7TJEY56Q, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 15 00:58:35.127619376 (151h32m29.558699507s) [noise=true , address=104.36.82.5:4850 , piece_id=7SR77YPK6YHRFA5XAW5UF4GJBJ6O4D43K7JG4DABG5SKXUHS3X2A, seg_pos={0 0}, upload=157620]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33792->104.36.82.5:4850: use of closed network connection
Aug 15 00:58:35.127632902 (151h32m29.558713033s) [seg_pos={0 0}, upload=157620]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 00:58:35.127685994 (151h32m29.558766115s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 00:58:35.127689711 (151h32m29.558769832s) [upload=157620]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 00:58:35.487086443 (151h32m29.918166564s) [upload=157620]: Done uploading segments...
Aug 15 00:58:35.487105570 (151h32m29.918185701s) [upload=157620]: Upload finished. err: <nil>
Duration: 5.681477115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..............X.........X.X...........] duration:
2.098074122s
FAIL (2025-08-15 01:19:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:12:14.379697931 (151h46m8.810778062s) [upload=157857]: Starting upload Aug 15 01:12:14.379758738 (151h46m8.810838869s) [upload=157857]: Done starting upload Aug 15 01:12:14.379842418 (151h46m8.810922539s) [upload=157857]: Uploading segments... Aug 15 01:12:14.379938722 (151h46m8.811018853s) [upload=157857]: Got next segment. Inline: true Aug 15 01:12:14.379943681 (151h46m8.811023812s) [upload=157857]: Waiting for error group managing segments... Aug 15 01:12:14.379998426 (151h46m8.811078547s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:12:14.380003255 (151h46m8.811083386s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:12:14.380006953 (151h46m8.811087074s) [upload=157857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:12:14.595025253 (151h46m9.026105374s) [upload=157857]: Done uploading segments... Aug 15 01:12:14.595043368 (151h46m9.026123499s) [upload=157857]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.098094601s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|