Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.437169626s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:10:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 4.437196058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.218519409s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:09:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 5.218542072s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.321858728s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:09:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 4.321883216s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
16.537073154s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:08:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 16.537098944s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.234389711s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:07:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 5.234412476s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.25110183s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:06:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 4.251130144s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.351287009s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:05:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 4.351313701s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.70583917s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:05:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 8.705861822s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
10.413333537s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:04:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 10.413358585s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.741500244s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:03:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 4.741528019s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
34.74608553s trace:
https://jaeger.dev.storj.io/trace/6fe9f9d68d2fb238
FAIL (2026-04-12 15:03:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
dress=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.182046009 (119h16m18.001282033s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.183307873 (119h16m18.002543897s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.184574267 (119h16m18.003810291s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.185836313 (119h16m18.005072337s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.187304256 (119h16m18.00654037s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.188500495 (119h16m18.00773652s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.189661796 (119h16m18.00889782s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.190407676 (119h16m18.0096437s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.191832836 (119h16m18.01106886s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Uploading piece...
Apr 12 15:02:31.982892599 (119h16m18.802128623s) [upload=114392]: Next returned nil segment
Apr 12 15:02:31.982904202 (119h16m18.802140226s) [upload=114392]: Waiting for error group managing segments...
Apr 12 15:02:32.368146024 (119h16m19.187382058s) [noise=true , address=185.167.204.205:4014 , piece_id=6DY6SJZF3BKREMUU3LAJYG5Q4BZTHW5XCHOSS7QZZIOWNKOUWEDQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.369544603 (119h16m19.188780627s) [noise=true , address=185.167.204.205:4012 , piece_id=SHDSJW2LIFJ2TOKWKSW6F623H3LFN3E473G5YDE34DH6LSY67HSA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.372202162 (119h16m19.191438186s) [noise=true , address=185.167.204.206:4054 , piece_id=S5ZTF67XJSD2AYF53ILLJW3V4QHXQ2RIW64IR5FAB4QLQLRQBZ7Q, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.374919786 (119h16m19.19415581s) [noise=true , address=185.167.204.206:4068 , piece_id=WBQ2TSP6ZC5ZNY36XHYAOJHIZVGZXEOBVWU26VBTCPEHI44JKNTA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.378336279 (119h16m19.197572304s) [noise=true , address=185.167.204.205:4033 , piece_id=GPSRRCVI4AK5HFWDEY7RGP6DOM5PMZLR4RFDN2FVMLEZXWYJU7QQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382188595 (119h16m19.201424619s) [noise=true , address=185.167.204.206:4057 , piece_id=UGPCADO2VWZY5I5IO7AI76L567UGUSFK4JS225ISRUCNU7Z4LP4A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.382887724 (119h16m19.202123748s) [noise=true , address=185.167.204.205:4015 , piece_id=GTFM76FYUWVPHQFSVNDN6PEUK5UVO44RMFUGYZRS5F7MEP7MQCIQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.386601461 (119h16m19.205837485s) [noise=true , address=185.167.204.206:4045 , piece_id=BIWPNC57V6T7PPTZXW65DLJ6PNUL7PEAVIZZVKETF7GROEGJDVEA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.387915467 (119h16m19.207151491s) [noise=true , address=185.167.204.206:4071 , piece_id=HX2MK7TJXOB6RSYGQNHH23KH2D2S4R26SDXDGMJJOIKTWI5LJOKQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.389153798 (119h16m19.208389822s) [noise=true , address=185.167.204.205:4022 , piece_id=D6JHWCYVNOJTQ7LBOONAJIFRM5O72OATP4B3FHIMC5T643VJBTYA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.390760037 (119h16m19.209996061s) [noise=true , address=185.167.204.206:4050 , piece_id=KCZOSUZTBXAQOYJ2OKFGGQR5SC3BNP6RZVHEHKJRLJAWFVSS4O3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391233811 (119h16m19.210469836s) [noise=true , address=185.167.204.205:4007 , piece_id=KJNGPH64JFGVQMXOGDN5LL2T7LXAQK2VISZMEOYFRYWL7ELNTK3A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.391585260 (119h16m19.210821284s) [noise=true , address=185.167.204.205:4026 , piece_id=HNDC4TQTW2FG2OHFN64VHIX5CSDLJPYKJEIVWD27OAF5JEEEKBMQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.394116024 (119h16m19.213352058s) [noise=true , address=185.167.204.206:4038 , piece_id=NZ5HB4O76WPBN5N55BX6GPGEZECGNBJR2ZUF2PR6BM7VN44P3FUA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.396812939 (119h16m19.216048973s) [noise=true , address=185.167.204.206:4037 , piece_id=W4SFMX2IPEUGTGP7BSOK5MEN7QLLUI3D5EYDECRXQQUI4NL5DQOQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:32.406971875 (119h16m19.226207899s) [noise=true , address=185.167.204.206:4051 , piece_id=VBCP6DIJGOSHVILLP2SQDC3DUQXDJQCWUIERFEFIZZMYXXBE23ZQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.417594020 (119h16m20.236830054s) [noise=true , address=81.171.14.70:4033 , piece_id=EZO2GMYGDME5AUHNTYOV63KVBDMU4WIJMC2CDCGCPMRTXOFKPXQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.440786119 (119h16m20.260022143s) [noise=true , address=81.171.14.70:4026 , piece_id=3WXO773N5RISVCQYUOY7A3AIMU5HPL2XQKKDNFXJJJL7CJYAJELQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:33.725838220 (119h16m20.545074244s) [noise=true , address=81.171.14.70:4031 , piece_id=HLGISGHDTXZZVQ6DUFCNHI5OE34QSYGDFZFOZDFE6HS7XMDS4TQA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.462448441 (119h16m21.281684465s) [noise=true , address=89.149.201.147:4007 , piece_id=ZQEO7LPWQT3XXWVKGJYZY3QEPINFI5433L23FDBVXCWKVCP2GFXA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.488924547 (119h16m21.308160571s) [noise=true , address=89.149.201.147:4011 , piece_id=HTDMJR53D7AMGHL53C7TRSHWQS3WPWRXLUCFCMIQYN4LWVHRSESA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.555968007 (119h16m21.375204032s) [noise=true , address=89.149.201.147:4020 , piece_id=4P6JU2PWSXGME36IQH67YX3GKWVUTEFMPUS6XI4AWILUQH5LMFBQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.818964944 (119h16m21.638200968s) [noise=true , address=81.171.14.70:4041 , piece_id=SGAAGV5JU7BFETNN2RUNMCE26AK7HH4DDHKGIHTTJCFTO2K5IDIA, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:34.934084358 (119h16m21.753320382s) [noise=true , address=81.171.14.70:4030 , piece_id=7X5WVD5PXJZF6I4CG756RXIKBTFLZTWGZPFF752CULODUA2QNISQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:35.090526110 (119h16m21.909762134s) [noise=true , address=89.149.201.147:4021 , piece_id=YQETY2M7WU4HM57XBRWARWMXSHSRMCFJO47WRNU7WIQ3TILLN76A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217902244 (119h16m23.037138268s) [noise=true , address=89.149.201.147:4014 , piece_id=FEZ5DKYJQENZFAD27KAIXCKEAWHMM4IFFH7MHE4MNJN2BVS6G3UQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: <nil>
Apr 12 15:02:36.217927131 (119h16m23.037163155s) [seg_pos={0 0}, upload=114392]: Satisfied cohort requirements after 26 pieces
Apr 12 15:02:36.218149490 (119h16m23.037385514s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 15:02:36.218157567 (119h16m23.037393591s) [noise=true , address=89.149.201.147:4023 , piece_id=QDKGGWB77T6B2ZB4QC6IM6X237GNC7EYMZAX3IJVW2R6SLKGW73A, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218165201 (119h16m23.037401215s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: read tcp 188.166.225.170:36140->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 12 15:02:36.218171243 (119h16m23.037407267s) [noise=true , address=81.171.14.70:4035 , piece_id=AXCK2APNQL7YNNNXU2PFQ23Y2EECDDBTXV3YFW7HLCGAJIAUTCLQ, seg_pos={0 0}, upload=114392]: Long tail cancellation due to optimal threshold
Apr 12 15:02:36.218232531 (119h16m23.037468555s) [seg_pos={0 0}, upload=114392]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 15:02:36.218420784 (119h16m23.037656798s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 15:02:36.218425002 (119h16m23.037661016s) [upload=114392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 15:02:36.465312618 (119h16m23.284548663s) [upload=114392]: Done uploading segments...
Apr 12 15:02:36.465332226 (119h16m23.28456825s) [upload=114392]: Upload finished. err: <nil>
Duration: 34.746130076s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.817593638s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:53:49 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.817614429s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.867761609s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:52:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.867791547s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.930253778s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:52:09 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.930268828s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
3.837145983s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:51:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.837163007s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
3.478870396s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:50:43 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.478893911s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
3.859676574s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:49:51 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.859694299s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
3.774991187s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:48:42 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.775029791s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
3.779005748s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:47:35 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.779024073s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
3.782933013s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:47:05 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.782961107s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
3.71271026s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:46:47 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.712733344s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
3.849213804s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:45:51 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.849246218s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
3.565749655s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:45:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.565793931s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
3.719061988s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:44:37 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.719084452s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
4.668949583s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:43:49 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.66897342s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
3.772643501s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:43:27 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.772666354s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
3.84796446s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:42:44 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.848032964s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
3.771775242s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:42:18 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.771799278s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.798445666s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:41:22 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.798472498s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
3.83437881s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:40:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.83439901s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
3.576722525s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:39:41 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.576748225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
3.621887889s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:38:34 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.621908409s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
3.445565307s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:37:19 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.445583052s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
3.546386327s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:36:14 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.546410134s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
3.472080584s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:35:42 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.47210365s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
3.541396039s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:35:16 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.541422519s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
3.900912524s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:34:39 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.900926481s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
3.839861408s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:33:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.839876638s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
3.879787334s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:33:30 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.879798627s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
3.791593072s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:32:52 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.791627028s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
3.836003203s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:32:30 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.836030175s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
3.88303956s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:31:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.883061603s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
3.795082568s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:31:03 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.795107516s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
3.834205551s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:30:35 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.834229698s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
3.783830686s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:29:43 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.783866955s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
3.490780273s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:28:58 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.490801604s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
3.51695117s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:28:17 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.516993461s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
3.468864768s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:27:37 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.468885939s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
3.375434488s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:26:41 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.375458344s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
3.460717775s trace:
https://jaeger.dev.storj.io/trace/1a15554eec7cde4a
FAIL (2026-04-12 12:26:16 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.460732263s
core
uplink
us-select-1
us1-placement-20
|