Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X......X.......................X......X......X...] duration:
7.147325594s
FAIL (2025-08-20 00:34:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e528fc5a29cb04c573ddb3d790435facf362784b84cd4cd98af282e328b39 != before 7524ca2b6a1a59859a882329b125b916296e01b2cb807588821975ad31c0df4e
======LOGS======
Aug 20 00:32:25.479281331 (271h6m19.910361462s) [upload=281900]: Starting upload
Aug 20 00:32:25.479320485 (271h6m19.910400616s) [upload=281900]: Done starting upload
Aug 20 00:32:25.479420918 (271h6m19.910501049s) [upload=281900]: Uploading segments...
Aug 20 00:32:25.479583739 (271h6m19.91066387s) [upload=281900]: Got next segment. Inline: false
Aug 20 00:32:25.479626671 (271h6m19.910706802s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:32:25.479631079 (271h6m19.9107112s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:32:25.970221149 (271h6m20.40130128s) [seg_pos={0 0}, upload=281900]: Begin upload segment...
Aug 20 00:32:25.970342751 (271h6m20.401422882s) [seg_pos={0 0}, upload=281900]: Done begin upload segment.
Aug 20 00:32:25.970351759 (271h6m20.40143189s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970381586 (271h6m20.401461727s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970732648 (271h6m20.401812779s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970893296 (271h6m20.401973417s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971197127 (271h6m20.402277258s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971394715 (271h6m20.402474846s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971597532 (271h6m20.402677664s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971934257 (271h6m20.403014389s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972232627 (271h6m20.403312759s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972502754 (271h6m20.403582886s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972733597 (271h6m20.403813728s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972815784 (271h6m20.403895915s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973148410 (271h6m20.404228541s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973500805 (271h6m20.404580936s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973527696 (271h6m20.404607827s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973750172 (271h6m20.404830293s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973984860 (271h6m20.405064991s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.974196055 (271h6m20.405276186s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:27.084717922 (271h6m21.515798053s) [upload=281900]: Next returned nil segment
Aug 20 00:32:27.084730987 (271h6m21.515811118s) [upload=281900]: Waiting for error group managing segments...
Aug 20 00:32:27.367591865 (271h6m21.798671996s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:27.979144700 (271h6m22.410224831s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.007089399 (271h6m22.43816953s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.018256085 (271h6m22.449336216s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.054392517 (271h6m22.485472648s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.066714454 (271h6m22.497794585s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.070300725 (271h6m22.501380856s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.074937327 (271h6m22.506017458s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.099985573 (271h6m22.531065704s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.103014358 (271h6m22.534094489s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.132496810 (271h6m22.563576941s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.138952842 (271h6m22.570032973s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.152160794 (271h6m22.583240915s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155625332 (271h6m22.586705453s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155639770 (271h6m22.586719901s) [seg_pos={0 0}, upload=281900]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:32:28.155790760 (271h6m22.586870891s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155857106 (271h6m22.586937237s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection
Aug 20 00:32:28.155881273 (271h6m22.586961404s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155924345 (271h6m22.587004466s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155947749 (271h6m22.587027881s) [seg_pos={0 0}, upload=281900]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:32:28.156022843 (271h6m22.587102964s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:32:28.156026931 (271h6m22.587107062s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:32:28.531137796 (271h6m22.962217917s) [upload=281900]: Done uploading segments...
Aug 20 00:32:28.531157083 (271h6m22.962237214s) [upload=281900]: Upload finished. err: <nil>
Duration: 7.147353347s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X......X.......................X......X......X..] duration:
6.077420975s
FAIL (2025-08-20 00:33:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e528fc5a29cb04c573ddb3d790435facf362784b84cd4cd98af282e328b39 != before 7524ca2b6a1a59859a882329b125b916296e01b2cb807588821975ad31c0df4e
======LOGS======
Aug 20 00:32:25.479281331 (271h6m19.910361462s) [upload=281900]: Starting upload
Aug 20 00:32:25.479320485 (271h6m19.910400616s) [upload=281900]: Done starting upload
Aug 20 00:32:25.479420918 (271h6m19.910501049s) [upload=281900]: Uploading segments...
Aug 20 00:32:25.479583739 (271h6m19.91066387s) [upload=281900]: Got next segment. Inline: false
Aug 20 00:32:25.479626671 (271h6m19.910706802s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:32:25.479631079 (271h6m19.9107112s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:32:25.970221149 (271h6m20.40130128s) [seg_pos={0 0}, upload=281900]: Begin upload segment...
Aug 20 00:32:25.970342751 (271h6m20.401422882s) [seg_pos={0 0}, upload=281900]: Done begin upload segment.
Aug 20 00:32:25.970351759 (271h6m20.40143189s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970381586 (271h6m20.401461727s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970732648 (271h6m20.401812779s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970893296 (271h6m20.401973417s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971197127 (271h6m20.402277258s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971394715 (271h6m20.402474846s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971597532 (271h6m20.402677664s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971934257 (271h6m20.403014389s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972232627 (271h6m20.403312759s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972502754 (271h6m20.403582886s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972733597 (271h6m20.403813728s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972815784 (271h6m20.403895915s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973148410 (271h6m20.404228541s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973500805 (271h6m20.404580936s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973527696 (271h6m20.404607827s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973750172 (271h6m20.404830293s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973984860 (271h6m20.405064991s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.974196055 (271h6m20.405276186s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:27.084717922 (271h6m21.515798053s) [upload=281900]: Next returned nil segment
Aug 20 00:32:27.084730987 (271h6m21.515811118s) [upload=281900]: Waiting for error group managing segments...
Aug 20 00:32:27.367591865 (271h6m21.798671996s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:27.979144700 (271h6m22.410224831s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.007089399 (271h6m22.43816953s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.018256085 (271h6m22.449336216s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.054392517 (271h6m22.485472648s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.066714454 (271h6m22.497794585s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.070300725 (271h6m22.501380856s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.074937327 (271h6m22.506017458s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.099985573 (271h6m22.531065704s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.103014358 (271h6m22.534094489s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.132496810 (271h6m22.563576941s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.138952842 (271h6m22.570032973s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.152160794 (271h6m22.583240915s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155625332 (271h6m22.586705453s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155639770 (271h6m22.586719901s) [seg_pos={0 0}, upload=281900]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:32:28.155790760 (271h6m22.586870891s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155857106 (271h6m22.586937237s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection
Aug 20 00:32:28.155881273 (271h6m22.586961404s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155924345 (271h6m22.587004466s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155947749 (271h6m22.587027881s) [seg_pos={0 0}, upload=281900]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:32:28.156022843 (271h6m22.587102964s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:32:28.156026931 (271h6m22.587107062s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:32:28.531137796 (271h6m22.962217917s) [upload=281900]: Done uploading segments...
Aug 20 00:32:28.531157083 (271h6m22.962237214s) [upload=281900]: Upload finished. err: <nil>
Duration: 6.077463527s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.................X....X..........X........X.....X...........] duration:
2.047412835s
FAIL (2025-08-20 00:33:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.047444536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X......X.......................X......X......X.] duration:
5.801439881s
FAIL (2025-08-20 00:32:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e528fc5a29cb04c573ddb3d790435facf362784b84cd4cd98af282e328b39 != before 7524ca2b6a1a59859a882329b125b916296e01b2cb807588821975ad31c0df4e
======LOGS======
Aug 20 00:32:25.479281331 (271h6m19.910361462s) [upload=281900]: Starting upload
Aug 20 00:32:25.479320485 (271h6m19.910400616s) [upload=281900]: Done starting upload
Aug 20 00:32:25.479420918 (271h6m19.910501049s) [upload=281900]: Uploading segments...
Aug 20 00:32:25.479583739 (271h6m19.91066387s) [upload=281900]: Got next segment. Inline: false
Aug 20 00:32:25.479626671 (271h6m19.910706802s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:32:25.479631079 (271h6m19.9107112s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:32:25.970221149 (271h6m20.40130128s) [seg_pos={0 0}, upload=281900]: Begin upload segment...
Aug 20 00:32:25.970342751 (271h6m20.401422882s) [seg_pos={0 0}, upload=281900]: Done begin upload segment.
Aug 20 00:32:25.970351759 (271h6m20.40143189s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970381586 (271h6m20.401461727s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970732648 (271h6m20.401812779s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970893296 (271h6m20.401973417s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971197127 (271h6m20.402277258s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971394715 (271h6m20.402474846s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971597532 (271h6m20.402677664s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971934257 (271h6m20.403014389s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972232627 (271h6m20.403312759s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972502754 (271h6m20.403582886s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972733597 (271h6m20.403813728s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972815784 (271h6m20.403895915s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973148410 (271h6m20.404228541s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973500805 (271h6m20.404580936s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973527696 (271h6m20.404607827s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973750172 (271h6m20.404830293s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973984860 (271h6m20.405064991s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.974196055 (271h6m20.405276186s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:27.084717922 (271h6m21.515798053s) [upload=281900]: Next returned nil segment
Aug 20 00:32:27.084730987 (271h6m21.515811118s) [upload=281900]: Waiting for error group managing segments...
Aug 20 00:32:27.367591865 (271h6m21.798671996s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:27.979144700 (271h6m22.410224831s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.007089399 (271h6m22.43816953s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.018256085 (271h6m22.449336216s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.054392517 (271h6m22.485472648s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.066714454 (271h6m22.497794585s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.070300725 (271h6m22.501380856s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.074937327 (271h6m22.506017458s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.099985573 (271h6m22.531065704s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.103014358 (271h6m22.534094489s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.132496810 (271h6m22.563576941s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.138952842 (271h6m22.570032973s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.152160794 (271h6m22.583240915s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155625332 (271h6m22.586705453s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155639770 (271h6m22.586719901s) [seg_pos={0 0}, upload=281900]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:32:28.155790760 (271h6m22.586870891s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155857106 (271h6m22.586937237s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection
Aug 20 00:32:28.155881273 (271h6m22.586961404s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155924345 (271h6m22.587004466s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155947749 (271h6m22.587027881s) [seg_pos={0 0}, upload=281900]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:32:28.156022843 (271h6m22.587102964s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:32:28.156026931 (271h6m22.587107062s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:32:28.531137796 (271h6m22.962217917s) [upload=281900]: Done uploading segments...
Aug 20 00:32:28.531157083 (271h6m22.962237214s) [upload=281900]: Upload finished. err: <nil>
Duration: 5.80146559s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..................X....X..........X........X.....X..........] duration:
2.561004791s
FAIL (2025-08-20 00:32:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.56102932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X......X.......................X......X......X] duration:
6.986198784s
FAIL (2025-08-20 00:32:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e528fc5a29cb04c573ddb3d790435facf362784b84cd4cd98af282e328b39 != before 7524ca2b6a1a59859a882329b125b916296e01b2cb807588821975ad31c0df4e
======LOGS======
Aug 20 00:32:25.479281331 (271h6m19.910361462s) [upload=281900]: Starting upload
Aug 20 00:32:25.479320485 (271h6m19.910400616s) [upload=281900]: Done starting upload
Aug 20 00:32:25.479420918 (271h6m19.910501049s) [upload=281900]: Uploading segments...
Aug 20 00:32:25.479583739 (271h6m19.91066387s) [upload=281900]: Got next segment. Inline: false
Aug 20 00:32:25.479626671 (271h6m19.910706802s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:32:25.479631079 (271h6m19.9107112s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:32:25.970221149 (271h6m20.40130128s) [seg_pos={0 0}, upload=281900]: Begin upload segment...
Aug 20 00:32:25.970342751 (271h6m20.401422882s) [seg_pos={0 0}, upload=281900]: Done begin upload segment.
Aug 20 00:32:25.970351759 (271h6m20.40143189s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970381586 (271h6m20.401461727s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970732648 (271h6m20.401812779s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.970893296 (271h6m20.401973417s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971197127 (271h6m20.402277258s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971394715 (271h6m20.402474846s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971597532 (271h6m20.402677664s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.971934257 (271h6m20.403014389s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972232627 (271h6m20.403312759s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972502754 (271h6m20.403582886s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972733597 (271h6m20.403813728s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.972815784 (271h6m20.403895915s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973148410 (271h6m20.404228541s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973500805 (271h6m20.404580936s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973527696 (271h6m20.404607827s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973750172 (271h6m20.404830293s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.973984860 (271h6m20.405064991s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:25.974196055 (271h6m20.405276186s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Uploading piece...
Aug 20 00:32:27.084717922 (271h6m21.515798053s) [upload=281900]: Next returned nil segment
Aug 20 00:32:27.084730987 (271h6m21.515811118s) [upload=281900]: Waiting for error group managing segments...
Aug 20 00:32:27.367591865 (271h6m21.798671996s) [noise=true , address=66.23.193.175:4560 , piece_id=Q7MGSLA5DFQTPGYYP3K56SNDCMD3T5VUBG35CGC2JHBZ2WVJ6IBQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:27.979144700 (271h6m22.410224831s) [noise=true , address=77.90.31.15:4725 , piece_id=DOOTUAA45UZSJGC6Q4CIJMF2V6PRCMXBHHP24HTSGSH5NUMVOMFA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.007089399 (271h6m22.43816953s) [noise=true , address=45.91.116.10:4104 , piece_id=2HCWBQH33NWLLPI4Y2A6UYKJJ357DXSYP7O4E4GXJ3FD5L6D53OQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.018256085 (271h6m22.449336216s) [noise=true , address=104.36.82.62:4441 , piece_id=ZL3AUNMGDO7AGZG6H2GLBHK5BMG5LC62ME7IFNCD2KSJNLPSMXYA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.054392517 (271h6m22.485472648s) [noise=true , address=104.36.82.14:4239 , piece_id=7U6K3IJ7BU2IUJEDXVOJI3NV63637MINYLE4IB7MKEXRUDZGVXQA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.066714454 (271h6m22.497794585s) [noise=true , address=45.91.116.8:4071 , piece_id=AOQ7EN4D32MNJBIX7PFNJEUPIS3KRVUMY3RCS5JISU2IKJYIS55Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.070300725 (271h6m22.501380856s) [noise=true , address=77.90.31.21:4899 , piece_id=JEHKPK4MXXIX2FNNBREH3536M5Z3DBE3TSWZ55AKU6BFW7T3UIOA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.074937327 (271h6m22.506017458s) [noise=true , address=104.36.82.2:4745 , piece_id=UAICK4NALLTDUZPJ5AFX6AIUXV4BYUJN4PCJ7BWKRDQGEGXWOPUQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.099985573 (271h6m22.531065704s) [noise=true , address=104.36.82.38:4689 , piece_id=K5V3TR47CABTWFKVL3PQADIZ5XXEUSFVW6QII6YJX6DSWSIWNZJA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.103014358 (271h6m22.534094489s) [noise=true , address=45.91.116.7:4039 , piece_id=VSLIFINO24OEL6W47WDRAWFOLYIM7Q72ZCMQPGSDE25SNM2ZPW5Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.132496810 (271h6m22.563576941s) [noise=true , address=104.36.82.39:4753 , piece_id=6JSNMKYZIA6EIQD35ZWFV65COJYSOIHBIYDBQPTNHFWNA2AVSEZA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.138952842 (271h6m22.570032973s) [noise=true , address=77.90.31.15:4701 , piece_id=5267GXFMZ4NS2D42HOFCBRRERGLOE2HEBSBTCHQEWQLWN7XOKHNA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.152160794 (271h6m22.583240915s) [noise=true , address=77.90.31.14:4670 , piece_id=SMKEKP4CIMAO5EIT5RP6MSJ2UX46M7UP2RUAYLBM7QFFLF7DT7TA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155625332 (271h6m22.586705453s) [noise=true , address=104.36.82.44:4889 , piece_id=BAPO74LJMSBUYMCU5MI42NSP4OXZOB6R4KFK6TGNCIGS4HY6HG3Q, seg_pos={0 0}, upload=281900]: Done uploading piece. err: <nil>
Aug 20 00:32:28.155639770 (271h6m22.586719901s) [seg_pos={0 0}, upload=281900]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:32:28.155790760 (271h6m22.586870891s) [noise=true , address=104.36.82.10:4080 , piece_id=WBCTTL5QQE5KCRI5FA3XNG52N76PCWCHLH6C6YP74TXDA64ZLAJQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155857106 (271h6m22.586937237s) [noise=true , address=104.36.82.5:4844 , piece_id=4GGO3G33DW3KC6SIRNK5SKJJUKT5PTUC3MBAID5577JXST3PG5HQ, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41218->104.36.82.5:4844: use of closed network connection
Aug 20 00:32:28.155881273 (271h6m22.586961404s) [noise=true , address=45.91.116.12:4235 , piece_id=V7NCFPU3C7FH2BAGGIXAI3CX4O4HUMANV5DBLH365MK2TQEUHOMA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155924345 (271h6m22.587004466s) [noise=true , address=104.36.82.60:4360 , piece_id=72DETVTWGPUZDNVNWC4CDJLIK6GD4CJV4IE22URMKKSPMMGMMTLA, seg_pos={0 0}, upload=281900]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF
Aug 20 00:32:28.155947749 (271h6m22.587027881s) [seg_pos={0 0}, upload=281900]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:32:28.156022843 (271h6m22.587102964s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:32:28.156026931 (271h6m22.587107062s) [upload=281900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:32:28.531137796 (271h6m22.962217917s) [upload=281900]: Done uploading segments...
Aug 20 00:32:28.531157083 (271h6m22.962237214s) [upload=281900]: Upload finished. err: <nil>
Duration: 6.98622867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X......X.......................X......X......] duration:
6.218639918s
FAIL (2025-08-20 00:32:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.218668163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..................X....X..........X........X.....X.........] duration:
1.906920169s
FAIL (2025-08-20 00:31:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.906938855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X......X.......................X......X.....] duration:
6.072329406s
FAIL (2025-08-20 00:31:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.07235262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..................X....X..........X........X.....X........] duration:
1.953634452s
FAIL (2025-08-20 00:31:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.953667946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X......X.......................X......X....] duration:
6.344568738s
FAIL (2025-08-20 00:30:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.344595259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X......X.......................X......X...] duration:
6.138810166s
FAIL (2025-08-20 00:30:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.138831846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..................X....X..........X........X.....X.......] duration:
1.979881162s
FAIL (2025-08-20 00:30:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.979909216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X......X.......................X......X..] duration:
7.009345328s
FAIL (2025-08-20 00:30:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.009378913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..................X....X..........X........X.....X......] duration:
2.274393681s
FAIL (2025-08-20 00:29:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.274410815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X......X.......................X......X.] duration:
6.108464294s
FAIL (2025-08-20 00:28:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.108490475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..................X....X..........X........X.....X.....] duration:
2.08318423s
FAIL (2025-08-20 00:28:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.083206661s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X......X.......................X......X] duration:
862.308594ms
FAIL (2025-08-20 00:28:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:28:30.143657104 (271h2m24.574737235s) [upload=281821]: Starting upload Aug 20 00:28:30.143705286 (271h2m24.574785417s) [upload=281821]: Done starting upload Aug 20 00:28:30.143803965 (271h2m24.574884086s) [upload=281821]: Uploading segments... Aug 20 00:28:30.143960405 (271h2m24.575040536s) [upload=281821]: Got next segment. Inline: false Aug 20 00:28:30.143998527 (271h2m24.575078658s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:28:30.144015360 (271h2m24.575095491s) [upload=281821]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:28:30.360447895 (271h2m24.791528026s) [upload=281821]: Next segment err: metaclient: Too Many Requests Aug 20 00:28:30.360469035 (271h2m24.791549166s) [upload=281821]: Done uploading segments... Aug 20 00:28:30.360483292 (271h2m24.791563423s) [upload=281821]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.337439ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..................X....X..........X........X.....X....] duration:
1.871252175s
FAIL (2025-08-20 00:27:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.871299396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X......X.......................X......] duration:
5.919841233s
FAIL (2025-08-20 00:27:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.919856993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..................X....X..........X........X.....X...] duration:
2.194830177s
FAIL (2025-08-20 00:26:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.194855306s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X......X.......................X.....] duration:
6.372492645s
FAIL (2025-08-20 00:26:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.372523003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..................X....X..........X........X.....X..] duration:
2.05477927s
FAIL (2025-08-20 00:26:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.054812303s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X......X.......................X....] duration:
8.663001298s
FAIL (2025-08-20 00:25:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.663029042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..................X....X..........X........X.....X.] duration:
1.920297195s
FAIL (2025-08-20 00:25:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.920339455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X......X.......................X...] duration:
6.697615657s
FAIL (2025-08-20 00:24:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.697640334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X..................X....X..........X........X.....X] duration:
931.510973ms
FAIL (2025-08-20 00:24:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:24:17.298949181 (270h58m11.730029302s) [upload=281752]: Starting upload Aug 20 00:24:17.299006581 (270h58m11.730086702s) [upload=281752]: Done starting upload Aug 20 00:24:17.299078127 (270h58m11.730158249s) [upload=281752]: Uploading segments... Aug 20 00:24:17.299115770 (270h58m11.730195901s) [upload=281752]: Got next segment. Inline: true Aug 20 00:24:17.299119477 (270h58m11.730199608s) [upload=281752]: Waiting for error group managing segments... Aug 20 00:24:17.299150977 (270h58m11.730231108s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:24:17.299155165 (270h58m11.730235286s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:24:17.299157600 (270h58m11.730237731s) [upload=281752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:24:17.515452120 (270h58m11.946532281s) [upload=281752]: Done uploading segments... Aug 20 00:24:17.515472749 (270h58m11.94655288s) [upload=281752]: Upload finished. err: metaclient: Too Many Requests
Duration: 931.538505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X..................X....X..........X........X.....] duration:
1.859148094s
FAIL (2025-08-20 00:23:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 1.859173772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......X.......................X..] duration:
6.782227417s
FAIL (2025-08-20 00:23:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.782256914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..................X....X..........X........X....] duration:
2.127371725s
FAIL (2025-08-20 00:23:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 2.127410179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X......X.......................X.] duration:
6.273190084s
FAIL (2025-08-20 00:22:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.273215813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X..................X....X..........X........X...] duration:
1.882155076s
FAIL (2025-08-20 00:22:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 1.882195183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X..................X....X..........X........X..] duration:
2.028335214s
FAIL (2025-08-20 00:22:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 2.028360282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X......X.......................X] duration:
868.512981ms
FAIL (2025-08-20 00:21:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:21:53.542300311 (270h55m47.973380442s) [upload=281711]: Starting upload Aug 20 00:21:53.542362671 (270h55m47.973442802s) [upload=281711]: Done starting upload Aug 20 00:21:53.542473864 (270h55m47.973553995s) [upload=281711]: Uploading segments... Aug 20 00:21:53.542563786 (270h55m47.973643917s) [upload=281711]: Got next segment. Inline: false Aug 20 00:21:53.542600415 (270h55m47.973680547s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:53.542606999 (270h55m47.97368713s) [upload=281711]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:21:53.759089548 (270h55m48.190169679s) [upload=281711]: Next segment err: metaclient: Too Many Requests Aug 20 00:21:53.759113733 (270h55m48.190193864s) [upload=281711]: Done uploading segments... Aug 20 00:21:53.759126388 (270h55m48.190206519s) [upload=281711]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.530475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.............X..................X....X..........X........X.] duration:
2.05361254s
FAIL (2025-08-20 00:21:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 2.053641937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......X.......................] duration:
6.513807215s
FAIL (2025-08-20 00:21:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.513831922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.............X..................X....X..........X........X] duration:
1.421796411s
FAIL (2025-08-20 00:21:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:21:18.629230116 (270h55m13.060310247s) [upload=281701]: Starting upload Aug 20 00:21:18.629277066 (270h55m13.060357197s) [upload=281701]: Done starting upload Aug 20 00:21:18.629334025 (270h55m13.060414146s) [upload=281701]: Uploading segments... Aug 20 00:21:18.629362640 (270h55m13.060442771s) [upload=281701]: Got next segment. Inline: true Aug 20 00:21:18.629366777 (270h55m13.060446898s) [upload=281701]: Waiting for error group managing segments... Aug 20 00:21:18.629401734 (270h55m13.060481865s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:21:18.629405973 (270h55m13.060486104s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:21:18.629408367 (270h55m13.060488488s) [upload=281701]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:21:18.922822126 (270h55m13.353902257s) [upload=281701]: Done uploading segments... Aug 20 00:21:18.922844949 (270h55m13.35392509s) [upload=281701]: Upload finished. err: <nil>
Duration: 1.421850105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......X......................] duration:
6.260559125s
FAIL (2025-08-20 00:21:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.260586458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.............X..................X....X..........X........] duration:
1.988842608s
FAIL (2025-08-20 00:20:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.988865945s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......X.....................] duration:
6.476289909s
FAIL (2025-08-20 00:20:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.476319095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.............X..................X....X..........X.......] duration:
2.037054447s
FAIL (2025-08-20 00:20:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.037090565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.............X..................X....X..........X......] duration:
1.918873712s
FAIL (2025-08-20 00:19:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.918896906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X......X....................] duration:
6.464404929s
FAIL (2025-08-20 00:19:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.464429215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.............X..................X....X..........X.....] duration:
1.940056491s
FAIL (2025-08-20 00:19:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.940084926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X................................X......X...................] duration:
6.05281071s
FAIL (2025-08-20 00:18:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.05283159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.............X..................X....X..........X....] duration:
2.481182634s
FAIL (2025-08-20 00:18:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.481200357s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X................................X......X..................] duration:
5.990825598s
FAIL (2025-08-20 00:18:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 5.990850967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.............X..................X....X..........X...] duration:
2.183250754s
FAIL (2025-08-20 00:18:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.183275s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.............X..................X....X..........X..] duration:
1.855774787s
FAIL (2025-08-20 00:17:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:16:30.339408655 (270h50m24.770488826s) [upload=281619]: Starting upload Aug 20 00:16:30.339477356 (270h50m24.770557497s) [upload=281619]: Done starting upload Aug 20 00:16:30.339559644 (270h50m24.770639815s) [upload=281619]: Uploading segments... Aug 20 00:16:30.339606824 (270h50m24.770686945s) [upload=281619]: Got next segment. Inline: true Aug 20 00:16:30.339611593 (270h50m24.770691724s) [upload=281619]: Waiting for error group managing segments... Aug 20 00:16:30.339653684 (270h50m24.770733815s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:16:30.339657702 (270h50m24.770737833s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:16:30.339660447 (270h50m24.770740578s) [upload=281619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:16:30.557845305 (270h50m24.988925436s) [upload=281619]: Done uploading segments... Aug 20 00:16:30.557862818 (270h50m24.988942959s) [upload=281619]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855809854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.X................................X......X.................] duration:
6.457175366s
FAIL (2025-08-20 00:17:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 519be8c485a9da6a974a673838f6fe276b14d61df0bb29201fd39280d2a679c3 != before 773bd9015146e8d675708dd76ac0d61519efae5494b06498c755b2112cdeb947
======LOGS======
Aug 20 00:05:09.053791183 (270h39m3.484871314s) [upload=281421]: Starting upload
Aug 20 00:05:09.053877207 (270h39m3.484957338s) [upload=281421]: Done starting upload
Aug 20 00:05:09.053948624 (270h39m3.485028755s) [upload=281421]: Uploading segments...
Aug 20 00:05:09.054050750 (270h39m3.485130881s) [upload=281421]: Got next segment. Inline: false
Aug 20 00:05:09.054082521 (270h39m3.485162652s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:05:09.054087380 (270h39m3.485167511s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:05:09.500963037 (270h39m3.932043169s) [seg_pos={0 0}, upload=281421]: Begin upload segment...
Aug 20 00:05:09.501002342 (270h39m3.932082473s) [seg_pos={0 0}, upload=281421]: Done begin upload segment.
Aug 20 00:05:09.501030055 (270h39m3.932110176s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501107213 (270h39m3.932187344s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501567694 (270h39m3.932647825s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501687623 (270h39m3.932767755s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.501985934 (270h39m3.933066065s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502118027 (270h39m3.933198158s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502336315 (270h39m3.933416446s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502521920 (270h39m3.933602051s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502660576 (270h39m3.933740707s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.502848626 (270h39m3.933928757s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503001457 (270h39m3.934081589s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503154110 (270h39m3.934234241s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503347209 (270h39m3.93442733s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503426962 (270h39m3.934507093s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503612197 (270h39m3.934692348s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503693272 (270h39m3.934773403s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.503893575 (270h39m3.934973706s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:09.504204940 (270h39m3.935285071s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Uploading piece...
Aug 20 00:05:10.631675636 (270h39m5.062755767s) [upload=281421]: Next returned nil segment
Aug 20 00:05:10.631692299 (270h39m5.06277242s) [upload=281421]: Waiting for error group managing segments...
Aug 20 00:05:10.915540423 (270h39m5.346620554s) [noise=true , address=79.127.205.235:4670 , piece_id=NLPEFJPLX5ADCTI2AD754DI4C5YOBPD4AW7AWCZMYCUNQC55CNCQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.419757647 (270h39m5.850837768s) [noise=true , address=104.36.82.7:4925 , piece_id=7OWFIBDCYLLXUX57K4FK6VOVM5ATZIHW4MLFA7HI5XDH56YKW6HQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.552008690 (270h39m5.983088821s) [noise=true , address=104.36.82.49:4998 , piece_id=YMVCN76WR2N6NI4BJEPD4WMKU7O7XFD7CO6L5GWJV2VVYUGILPDQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.584693518 (270h39m6.015773639s) [noise=true , address=104.36.82.60:4353 , piece_id=EYCXLITDQIAU6LIYDRNZZDACEAPWNKA7J5UD3VEFFJFWCYOCQYQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.590271481 (270h39m6.021351612s) [noise=true , address=104.36.82.17:4334 , piece_id=D2YX4Z7EIA62DORLZB4TUDGRRPCJL4GQ4CZMQN76S6D7YHGCYQKA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.597877985 (270h39m6.028958116s) [noise=true , address=104.36.82.34:4569 , piece_id=2X3WQMOECQNY4J5O2OQLK5TDEXJPFS3SEW7MNX42HIFTGLTGHBQA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.616024186 (270h39m6.047104317s) [noise=true , address=104.36.82.6:4900 , piece_id=GACCUWFLWZHMR76EWOKUXS4IHJRO5PK6KJVMFFOPKYXYZLDEIOUA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.825239390 (270h39m6.256319521s) [noise=true , address=77.90.31.14:4691 , piece_id=TEUJOUFYA3CQYHXXA53C7D7C5XNBNNKR2HTP3NVS4UQEPHVOH34A, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:11.900476386 (270h39m6.331556517s) [noise=true , address=104.36.82.44:4890 , piece_id=V4KQIMOO6F2OIYGMWQ4BZQBSGSEL44X23PVKAP5DHQSKHVV34RTA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.050020289 (270h39m6.48110042s) [noise=true , address=45.91.116.6:4005 , piece_id=MUY4L7YYPQMTFDSMOPRFM5MHDTGD4S35ACNC2DA6ELQZUOKRBKMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.063699953 (270h39m6.494780084s) [noise=true , address=77.90.31.19:4856 , piece_id=6C2WZL5GIAFDZ2ZCBIBRA7PIOTSO25UM56SFN73OV3S54CLXOCHQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.065211025 (270h39m6.496291156s) [noise=true , address=45.91.116.4:4963 , piece_id=NI7XAFLKT6X444CQBXSUO6V4L6J7RAIXBRY4ZMZSDH23XVXRZSXQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.070671833 (270h39m6.501751984s) [noise=true , address=77.90.31.12:4619 , piece_id=S7Z5K5DUITYSOGVMLAYXGYX2OXWHRU73N534XBAGKYV745CLPKHA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178362766 (270h39m6.609442897s) [noise=true , address=77.90.31.13:4632 , piece_id=DVM4IQDP6YBGDCYE5HRDSX7AHJMUSBW2E5K6EJJTAOH4CTKFGIMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: <nil>
Aug 20 00:05:12.178393594 (270h39m6.609473725s) [seg_pos={0 0}, upload=281421]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:05:12.178510267 (270h39m6.609590398s) [noise=true , address=104.36.82.11:4140 , piece_id=ASZWDJTIEYSLYWVKLWRDN6SVVK7AEICJUGEAGF5P32SXVCG44IMA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AYQRkKcRprBgX1BdUwnd4MCQ1swYucsG9aYvLLEaskgrngkCB): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178575012 (270h39m6.609655143s) [noise=true , address=45.91.116.12:4251 , piece_id=7AYI47RFL3LG4DGYXNI2OFZWDKKBQBSEVACCN6V3HJYSHCCQZFMQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZNCRKd7xMFNHfCJBJ38yfyUmczhYwJetKtiQxX9SDrwxRhzTU): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178628635 (270h39m6.609708766s) [noise=true , address=45.91.116.10:4097 , piece_id=I2SWWWXRJ5VYHA5DPQL7WUFTFH5J76FAOKCBR3EXF74AZOSN3KYA, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcwSEGPEpd59dUukENRoUykRyqmVLiGcKEBbJ72qr9b5tpoEY): protocol: expected piece hash; context canceled; EOF
Aug 20 00:05:12.178716633 (270h39m6.609796764s) [noise=true , address=45.91.116.11:4151 , piece_id=S2HCCXEFWGADF56ZBPLDMHO4PZHZ4NRC6RPLA4TZZGWPJMCTGAFQ, seg_pos={0 0}, upload=281421]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44498->45.91.116.11:4151: use of closed network connection
Aug 20 00:05:12.178746440 (270h39m6.609826561s) [seg_pos={0 0}, upload=281421]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:05:12.178823077 (270h39m6.609903198s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:05:12.178827665 (270h39m6.609907796s) [upload=281421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:05:12.468519712 (270h39m6.899599893s) [upload=281421]: Done uploading segments...
Aug 20 00:05:12.468539110 (270h39m6.899619241s) [upload=281421]: Upload finished. err: <nil>
Duration: 6.457230421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|