Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.608704428s trace:
https://jaeger.dev.storj.io/trace/265f3259a7705b6d
FAIL (2025-12-23 08:49:07 UTC)
orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded
Duration: 5.608733504s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.20703334s trace:
https://jaeger.dev.storj.io/trace/fbd33bd94283fbe
FAIL (2025-12-23 08:49:02 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 6.20706026s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
17.158468802s trace:
https://jaeger.dev.storj.io/trace/3b621a03316dcb85
FAIL (2025-12-23 08:49:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, Piece ID: MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ) context deadline exceeded; piecestore: (Node ID: 14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj, Piece ID: SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ) context deadline exceeded; piecestore: (Node ID: 124taxpXdSnzEkq6UG1ZPi7cKLkaoDSc3G9FH1YHbGbDwMTM8PG, Piece ID: XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA) context deadline exceeded; piecestore: (Node ID: 121nTAu2qwnGorPfRFRJ7kE4hSsPq9p8zCZVFtt7cNNGu1HGdnN, Piece ID: KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA) context deadline exceeded
======LOGS======
3358]: Uploading piece...
Dec 23 08:47:14.746900773 (425h18m14.617983818s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.749939840 (425h18m14.621022885s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.753510229 (425h18m14.624593264s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.755262356 (425h18m14.626345391s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.756625842 (425h18m14.627708877s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.758025117 (425h18m14.629108172s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.760642110 (425h18m14.631725145s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.761429270 (425h18m14.632512315s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763241921 (425h18m14.634324966s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763973835 (425h18m14.63505688s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765312685 (425h18m14.63639573s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765648824 (425h18m14.636731869s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.767253601 (425h18m14.638336636s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.768200434 (425h18m14.639283469s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:16.245896991 (425h18m16.116980036s) [upload=373358]: Next returned nil segment
Dec 23 08:47:16.245944181 (425h18m16.117027226s) [upload=373358]: Waiting for error group managing segments...
Dec 23 08:47:16.644138110 (425h18m16.515221145s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.131664201 (425h18m17.002747236s) [noise=true , address=64.49.13.139:4475 , piece_id=TH3UWCMUNGGADRA26PZNKZLOWCLRLRWIT23ONF2B2DJ3NMMFPZBQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.444602902 (425h18m17.315685947s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.470421138 (425h18m17.341504173s) [noise=true , address=77.90.31.13:4630 , piece_id=SOJYUZH676PZYM4Z5YGEXW4ZXPAVLSEIFFZBE22LGAUOMRRKVG7A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.554527268 (425h18m17.425610313s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.059191355 (425h18m17.93027439s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.354549959 (425h18m18.225633004s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.436262252 (425h18m18.307345297s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.800612455 (425h18m18.67169549s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.973704980 (425h18m18.844788025s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.276001403 (425h18m19.147084438s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.339083580 (425h18m19.210166625s) [noise=true , address=77.90.31.19:4876 , piece_id=EO3PO3DW5CXWWO4T6ND7J4JTZYC3RI35MLMUEQXQVEABP63LQMQQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.349762695 (425h18m19.22084573s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636789835 (425h18m20.50787288s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636817878 (425h18m20.507900923s) [seg_pos={0 0}, upload=373358]: Segment reached optimal threshold of 14 pieces.
Dec 23 08:47:20.637067674 (425h18m20.508150709s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Dec 23 08:47:20.637077883 (425h18m20.508160938s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637240834 (425h18m20.508323879s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection
Dec 23 08:47:20.637249079 (425h18m20.508332125s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637346505 (425h18m20.50842956s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection
Dec 23 08:47:20.637368196 (425h18m20.508451241s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637562967 (425h18m20.508646012s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1acQG8MjLvgzmCs8ELswcsKJrNvYmGQLX1FL4dHeCj2AUH7A5R): protocol: read tcp 188.166.225.170:56478->45.91.116.13:4170: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 23 08:47:20.637572605 (425h18m20.50865564s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637715547 (425h18m20.508798592s) [seg_pos={0 0}, upload=373358]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 23 08:47:20.637871194 (425h18m20.508954239s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 08:47:20.637878588 (425h18m20.508961633s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 08:47:21.234004555 (425h18m21.10508763s) [upload=373358]: Done uploading segments...
Dec 23 08:47:21.234072815 (425h18m21.10515586s) [upload=373358]: Upload finished. err: <nil>
Duration: 17.158492958s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.43863287s trace:
https://jaeger.dev.storj.io/trace/6156a7d944a046d
FAIL (2025-12-23 08:48:58 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 6.438659732s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.11193404s trace:
https://jaeger.dev.storj.io/trace/3727d7c571aed99f
FAIL (2025-12-23 08:48:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.111962003s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.445544755s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:48:55 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.445576104s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.995456778s trace:
https://jaeger.dev.storj.io/trace/265f3259a7705b6d
FAIL (2025-12-23 08:48:43 UTC)
orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded
Duration: 4.995485262s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
9.1451343s trace:
https://jaeger.dev.storj.io/trace/6156a7d944a046d
FAIL (2025-12-23 08:48:35 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 9.145164587s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
16.842478602s trace:
https://jaeger.dev.storj.io/trace/3b621a03316dcb85
FAIL (2025-12-23 08:48:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, Piece ID: MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ) context deadline exceeded; piecestore: (Node ID: 14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj, Piece ID: SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ) context deadline exceeded; piecestore: (Node ID: 124taxpXdSnzEkq6UG1ZPi7cKLkaoDSc3G9FH1YHbGbDwMTM8PG, Piece ID: XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA) context deadline exceeded; piecestore: (Node ID: 121nTAu2qwnGorPfRFRJ7kE4hSsPq9p8zCZVFtt7cNNGu1HGdnN, Piece ID: KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA) context deadline exceeded
======LOGS======
3358]: Uploading piece...
Dec 23 08:47:14.746900773 (425h18m14.617983818s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.749939840 (425h18m14.621022885s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.753510229 (425h18m14.624593264s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.755262356 (425h18m14.626345391s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.756625842 (425h18m14.627708877s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.758025117 (425h18m14.629108172s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.760642110 (425h18m14.631725145s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.761429270 (425h18m14.632512315s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763241921 (425h18m14.634324966s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763973835 (425h18m14.63505688s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765312685 (425h18m14.63639573s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765648824 (425h18m14.636731869s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.767253601 (425h18m14.638336636s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.768200434 (425h18m14.639283469s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:16.245896991 (425h18m16.116980036s) [upload=373358]: Next returned nil segment
Dec 23 08:47:16.245944181 (425h18m16.117027226s) [upload=373358]: Waiting for error group managing segments...
Dec 23 08:47:16.644138110 (425h18m16.515221145s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.131664201 (425h18m17.002747236s) [noise=true , address=64.49.13.139:4475 , piece_id=TH3UWCMUNGGADRA26PZNKZLOWCLRLRWIT23ONF2B2DJ3NMMFPZBQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.444602902 (425h18m17.315685947s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.470421138 (425h18m17.341504173s) [noise=true , address=77.90.31.13:4630 , piece_id=SOJYUZH676PZYM4Z5YGEXW4ZXPAVLSEIFFZBE22LGAUOMRRKVG7A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.554527268 (425h18m17.425610313s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.059191355 (425h18m17.93027439s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.354549959 (425h18m18.225633004s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.436262252 (425h18m18.307345297s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.800612455 (425h18m18.67169549s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.973704980 (425h18m18.844788025s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.276001403 (425h18m19.147084438s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.339083580 (425h18m19.210166625s) [noise=true , address=77.90.31.19:4876 , piece_id=EO3PO3DW5CXWWO4T6ND7J4JTZYC3RI35MLMUEQXQVEABP63LQMQQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.349762695 (425h18m19.22084573s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636789835 (425h18m20.50787288s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636817878 (425h18m20.507900923s) [seg_pos={0 0}, upload=373358]: Segment reached optimal threshold of 14 pieces.
Dec 23 08:47:20.637067674 (425h18m20.508150709s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Dec 23 08:47:20.637077883 (425h18m20.508160938s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637240834 (425h18m20.508323879s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection
Dec 23 08:47:20.637249079 (425h18m20.508332125s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637346505 (425h18m20.50842956s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection
Dec 23 08:47:20.637368196 (425h18m20.508451241s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637562967 (425h18m20.508646012s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1acQG8MjLvgzmCs8ELswcsKJrNvYmGQLX1FL4dHeCj2AUH7A5R): protocol: read tcp 188.166.225.170:56478->45.91.116.13:4170: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 23 08:47:20.637572605 (425h18m20.50865564s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637715547 (425h18m20.508798592s) [seg_pos={0 0}, upload=373358]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 23 08:47:20.637871194 (425h18m20.508954239s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 08:47:20.637878588 (425h18m20.508961633s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 08:47:21.234004555 (425h18m21.10508763s) [upload=373358]: Done uploading segments...
Dec 23 08:47:21.234072815 (425h18m21.10515586s) [upload=373358]: Upload finished. err: <nil>
Duration: 16.842508028s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.960113699s trace:
https://jaeger.dev.storj.io/trace/3c39be5f434273aa
FAIL (2025-12-23 08:48:25 UTC)
orbiter warning: context deadline exceeded
Duration: 5.960129267s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.020584407s trace:
https://jaeger.dev.storj.io/trace/265f3259a7705b6d
FAIL (2025-12-23 08:48:23 UTC)
orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded
Duration: 5.02060142s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
7.772919989s trace:
https://jaeger.dev.storj.io/trace/fbd33bd94283fbe
FAIL (2025-12-23 08:48:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 7.772949003s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
8.124173077s trace:
https://jaeger.dev.storj.io/trace/6156a7d944a046d
FAIL (2025-12-23 08:48:05 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 8.124203764s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
11.353166706s trace:
https://jaeger.dev.storj.io/trace/3b621a03316dcb85
FAIL (2025-12-23 08:47:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, Piece ID: MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ) context deadline exceeded; piecestore: (Node ID: 14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj, Piece ID: SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ) context deadline exceeded; piecestore: (Node ID: 124taxpXdSnzEkq6UG1ZPi7cKLkaoDSc3G9FH1YHbGbDwMTM8PG, Piece ID: XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA) context deadline exceeded; piecestore: (Node ID: 121nTAu2qwnGorPfRFRJ7kE4hSsPq9p8zCZVFtt7cNNGu1HGdnN, Piece ID: KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA) context deadline exceeded
======LOGS======
3358]: Uploading piece...
Dec 23 08:47:14.746900773 (425h18m14.617983818s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.749939840 (425h18m14.621022885s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.753510229 (425h18m14.624593264s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.755262356 (425h18m14.626345391s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.756625842 (425h18m14.627708877s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.758025117 (425h18m14.629108172s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.760642110 (425h18m14.631725145s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.761429270 (425h18m14.632512315s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763241921 (425h18m14.634324966s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763973835 (425h18m14.63505688s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765312685 (425h18m14.63639573s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765648824 (425h18m14.636731869s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.767253601 (425h18m14.638336636s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.768200434 (425h18m14.639283469s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:16.245896991 (425h18m16.116980036s) [upload=373358]: Next returned nil segment
Dec 23 08:47:16.245944181 (425h18m16.117027226s) [upload=373358]: Waiting for error group managing segments...
Dec 23 08:47:16.644138110 (425h18m16.515221145s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.131664201 (425h18m17.002747236s) [noise=true , address=64.49.13.139:4475 , piece_id=TH3UWCMUNGGADRA26PZNKZLOWCLRLRWIT23ONF2B2DJ3NMMFPZBQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.444602902 (425h18m17.315685947s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.470421138 (425h18m17.341504173s) [noise=true , address=77.90.31.13:4630 , piece_id=SOJYUZH676PZYM4Z5YGEXW4ZXPAVLSEIFFZBE22LGAUOMRRKVG7A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.554527268 (425h18m17.425610313s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.059191355 (425h18m17.93027439s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.354549959 (425h18m18.225633004s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.436262252 (425h18m18.307345297s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.800612455 (425h18m18.67169549s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.973704980 (425h18m18.844788025s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.276001403 (425h18m19.147084438s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.339083580 (425h18m19.210166625s) [noise=true , address=77.90.31.19:4876 , piece_id=EO3PO3DW5CXWWO4T6ND7J4JTZYC3RI35MLMUEQXQVEABP63LQMQQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.349762695 (425h18m19.22084573s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636789835 (425h18m20.50787288s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636817878 (425h18m20.507900923s) [seg_pos={0 0}, upload=373358]: Segment reached optimal threshold of 14 pieces.
Dec 23 08:47:20.637067674 (425h18m20.508150709s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Dec 23 08:47:20.637077883 (425h18m20.508160938s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637240834 (425h18m20.508323879s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection
Dec 23 08:47:20.637249079 (425h18m20.508332125s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637346505 (425h18m20.50842956s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection
Dec 23 08:47:20.637368196 (425h18m20.508451241s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637562967 (425h18m20.508646012s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1acQG8MjLvgzmCs8ELswcsKJrNvYmGQLX1FL4dHeCj2AUH7A5R): protocol: read tcp 188.166.225.170:56478->45.91.116.13:4170: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 23 08:47:20.637572605 (425h18m20.50865564s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637715547 (425h18m20.508798592s) [seg_pos={0 0}, upload=373358]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 23 08:47:20.637871194 (425h18m20.508954239s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 08:47:20.637878588 (425h18m20.508961633s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 08:47:21.234004555 (425h18m21.10508763s) [upload=373358]: Done uploading segments...
Dec 23 08:47:21.234072815 (425h18m21.10515586s) [upload=373358]: Upload finished. err: <nil>
Duration: 11.35318429s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.829806872s trace:
https://jaeger.dev.storj.io/trace/fbd33bd94283fbe
FAIL (2025-12-23 08:47:57 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 6.829833592s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.021640807s trace:
https://jaeger.dev.storj.io/trace/3727d7c571aed99f
FAIL (2025-12-23 08:47:50 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.021670975s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.436251226s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:47:47 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.436278038s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.003626715s trace:
https://jaeger.dev.storj.io/trace/3b621a03316dcb85
FAIL (2025-12-23 08:47:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1NgPjVCyZZAfxVr3WvKrGRjnkpPtUvmQcCMiYntxNKVSWqXcHC, Piece ID: MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ) context deadline exceeded; piecestore: (Node ID: 14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj, Piece ID: SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ) context deadline exceeded; piecestore: (Node ID: 124taxpXdSnzEkq6UG1ZPi7cKLkaoDSc3G9FH1YHbGbDwMTM8PG, Piece ID: XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA) context deadline exceeded; piecestore: (Node ID: 121nTAu2qwnGorPfRFRJ7kE4hSsPq9p8zCZVFtt7cNNGu1HGdnN, Piece ID: KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA) context deadline exceeded
======LOGS======
3358]: Uploading piece...
Dec 23 08:47:14.746900773 (425h18m14.617983818s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.749939840 (425h18m14.621022885s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.753510229 (425h18m14.624593264s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.755262356 (425h18m14.626345391s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.756625842 (425h18m14.627708877s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.758025117 (425h18m14.629108172s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.760642110 (425h18m14.631725145s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.761429270 (425h18m14.632512315s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763241921 (425h18m14.634324966s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.763973835 (425h18m14.63505688s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765312685 (425h18m14.63639573s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.765648824 (425h18m14.636731869s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.767253601 (425h18m14.638336636s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:14.768200434 (425h18m14.639283469s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Uploading piece...
Dec 23 08:47:16.245896991 (425h18m16.116980036s) [upload=373358]: Next returned nil segment
Dec 23 08:47:16.245944181 (425h18m16.117027226s) [upload=373358]: Waiting for error group managing segments...
Dec 23 08:47:16.644138110 (425h18m16.515221145s) [noise=true , address=145.79.227.3:4171 , piece_id=2ISHFXQR7VICM3SDXJ4HG5TF7AYMVHAVKYUUQ3XQI7NQKI6PZLLQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.131664201 (425h18m17.002747236s) [noise=true , address=64.49.13.139:4475 , piece_id=TH3UWCMUNGGADRA26PZNKZLOWCLRLRWIT23ONF2B2DJ3NMMFPZBQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.444602902 (425h18m17.315685947s) [noise=true , address=145.79.227.49:4352 , piece_id=GQK36CQOHIY4FYIMUAVINQBLS2WYMFSEPNG34RKKG2ZBD544DLTA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.470421138 (425h18m17.341504173s) [noise=true , address=77.90.31.13:4630 , piece_id=SOJYUZH676PZYM4Z5YGEXW4ZXPAVLSEIFFZBE22LGAUOMRRKVG7A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:17.554527268 (425h18m17.425610313s) [noise=true , address=145.79.227.30:4772 , piece_id=KZDCAC4ZBLROH4YV3ANRYCSHLZ7OJHWWUIY46ISTW2HHLCLSR53Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.059191355 (425h18m17.93027439s) [noise=true , address=77.90.31.21:4893 , piece_id=MNIKI3ZCNWZLWZ3TXYRADGNVXMIAMRSZZLJCOTDC6JEYTPVKZXFQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.354549959 (425h18m18.225633004s) [noise=true , address=145.79.227.44:4208 , piece_id=YHWJ6CSFQ2RPBR4B5N4GOAMWRIMFEJMCSUR6QOBFMP6D3R3AMZGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.436262252 (425h18m18.307345297s) [noise=true , address=77.90.31.14:4689 , piece_id=4APHUPZVMUIEVO4OLQJVZEMUGBAN52JH352LODHJOWTTBUPWGPEA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.800612455 (425h18m18.67169549s) [noise=true , address=5.231.73.5:4009 , piece_id=KJTR5KHSIYZKDLZJPDBTOU6X7HG7PEMW64NPXDMMKW7OLMKKSWQA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:18.973704980 (425h18m18.844788025s) [noise=true , address=77.90.31.11:4586 , piece_id=R6JMMBJQBYTSUNIISYRZIJEE5HF6CFIZ6T7TDVTS2JAEMV6JGX4A, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.276001403 (425h18m19.147084438s) [noise=true , address=45.91.116.10:4108 , piece_id=XHUTQNL3KUOF6TMLX5OMCWSVP3TKCO2R27P66C4RMIHZUTJIB6BA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.339083580 (425h18m19.210166625s) [noise=true , address=77.90.31.19:4876 , piece_id=EO3PO3DW5CXWWO4T6ND7J4JTZYC3RI35MLMUEQXQVEABP63LQMQQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:19.349762695 (425h18m19.22084573s) [noise=true , address=77.90.31.15:4704 , piece_id=SOECN5LE7ZVW6Y22V26SRP2PS52RSTPMW22QQNIV3TR72Z7VI7VQ, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636789835 (425h18m20.50787288s) [noise=true , address=45.91.116.4:4963 , piece_id=5VBEH5PT3TB2MFIERPIUJRWOXG7BZ5W7IY7DDB52KMQPC6WXZB6Q, seg_pos={0 0}, upload=373358]: Done uploading piece. err: <nil>
Dec 23 08:47:20.636817878 (425h18m20.507900923s) [seg_pos={0 0}, upload=373358]: Segment reached optimal threshold of 14 pieces.
Dec 23 08:47:20.637067674 (425h18m20.508150709s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Dec 23 08:47:20.637077883 (425h18m20.508160938s) [noise=true , address=77.90.31.12:4602 , piece_id=JQUMVMVQ2XDQLP7WMXGQ4Q3WXN54XPR47KNRZ4XTU7R67KQ65XGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637240834 (425h18m20.508323879s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47330->64.49.13.169:4711: use of closed network connection
Dec 23 08:47:20.637249079 (425h18m20.508332125s) [noise=true , address=64.49.13.169:4711 , piece_id=HWAE2EG7HNSLR2QHDEV6MGDQB4WAUNNRTFVEHLOUFV23HBRUWGGA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637346505 (425h18m20.50842956s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM): protocol: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43634->77.90.31.17:4791: use of closed network connection
Dec 23 08:47:20.637368196 (425h18m20.508451241s) [noise=true , address=77.90.31.17:4791 , piece_id=Q5J37SE6XBUANPYD5GRXBSSN43FRYWQDVH3Q6JMAGYAHGG2STQBA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637562967 (425h18m20.508646012s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1acQG8MjLvgzmCs8ELswcsKJrNvYmGQLX1FL4dHeCj2AUH7A5R): protocol: read tcp 188.166.225.170:56478->45.91.116.13:4170: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 23 08:47:20.637572605 (425h18m20.50865564s) [noise=true , address=45.91.116.13:4170 , piece_id=I6FP3YTSKFBTZHL6G45VY57FKRG3KGVUKDO55UED5TSNC4VE62IA, seg_pos={0 0}, upload=373358]: Long tail cancellation due to optimal threshold
Dec 23 08:47:20.637715547 (425h18m20.508798592s) [seg_pos={0 0}, upload=373358]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 23 08:47:20.637871194 (425h18m20.508954239s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 08:47:20.637878588 (425h18m20.508961633s) [upload=373358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 08:47:21.234004555 (425h18m21.10508763s) [upload=373358]: Done uploading segments...
Dec 23 08:47:21.234072815 (425h18m21.10515586s) [upload=373358]: Upload finished. err: <nil>
Duration: 1m0.003651803s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.061149901s trace:
https://jaeger.dev.storj.io/trace/3727d7c571aed99f
FAIL (2025-12-23 08:47:33 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.061169748s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
8.051015582s trace:
https://jaeger.dev.storj.io/trace/265f3259a7705b6d
FAIL (2025-12-23 08:47:32 UTC)
orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded
Duration: 8.051046991s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.378129594s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:47:30 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.378161575s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001763178s trace:
https://jaeger.dev.storj.io/trace/3727d7c571aed99f
FAIL (2025-12-23 08:47:23 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001786091s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.007482038s trace:
https://jaeger.dev.storj.io/trace/265f3259a7705b6d
FAIL (2025-12-23 08:47:23 UTC)
orbiter warning: operation: sync2.Copy uplink: metaclient: context deadline exceeded
Duration: 30.00750449s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.706498289s trace:
https://jaeger.dev.storj.io/trace/3c39be5f434273aa
FAIL (2025-12-23 08:47:19 UTC)
orbiter warning: context deadline exceeded
Duration: 6.706513268s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001109395s trace:
https://jaeger.dev.storj.io/trace/6156a7d944a046d
FAIL (2025-12-23 08:47:17 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 30.001129825s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001363994s trace:
https://jaeger.dev.storj.io/trace/fbd33bd94283fbe
FAIL (2025-12-23 08:47:14 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001386836s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000603635s trace:
https://jaeger.dev.storj.io/trace/3c39be5f434273aa
FAIL (2025-12-23 08:47:12 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000625638s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.458230249s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:46:19 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.458260827s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.448305608s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:45:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.448330276s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.420571666s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:44:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.420598298s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.395345365s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:44:20 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.395378567s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.392872535s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:43:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.393002563s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.351573084s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:42:40 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.351635563s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.385593292s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:42:19 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.385624362s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.427061717s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:42:01 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.427087836s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.386632974s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:40:53 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.386658894s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.408097646s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:39:49 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.408124808s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.394526966s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:39:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.39455538s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.397827369s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:38:44 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.397856294s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.399603222s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:37:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.399631687s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.433906672s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:36:58 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.433935528s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.375350931s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:36:05 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.375382251s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.376566116s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:35:14 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.376599971s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.416325715s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:34:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.416358777s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.436898891s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:33:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.436929861s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.382327315s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:32:47 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.382353705s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.369459431s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:32:03 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.369491843s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.151841504s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:31:08 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.151883654s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001828211s trace:
https://jaeger.dev.storj.io/trace/292b9465c989993a
FAIL (2025-12-23 08:30:49 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 30.001855744s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
248.946473ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/1e922f3feb1984b6
FAIL (2025-12-23 03:21:28 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 248.972935ms
edge
linksharing
bgp
eu1
|