Dear John,

this is what stratis reports after deleting about 50GB of data from /mnt/home and about 30GB of data from /mnt/opt:

# stratis pool
Name                         Total / Used / Free    Properties                                   UUID   Alerts
stratis_hdd   1.43 TiB / 819.34 GiB / 645.49 GiB    Ca,~Cr, Op   093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001 

# stratis blockdev
Pool Name     Device Node   Physical Size    Tier   UUID                                 
stratis_hdd   /dev/dm-6          1.43 TiB    DATA   9a5b1c4d-8014-4155-990e-eedfd27803a6
stratis_hdd   /dev/dm-7        292.95 GiB   CACHE   770d0190-c17b-4349-a9f9-0968036e6b2c

# stratis fs
Pool          Filesystem   Total / Used / Free / Limit              Created             Device                          UUID
                                
stratis_hdd   home         2 TiB / 708.75 GiB / 1.31 TiB / None     Apr 28 2019 12:29   /dev/stratis/stratis_hdd/home   1715
5095-e225-4fb0-b020-ec2ffa6a5e4d
stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 28 2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
a29e-ab39-4b41-8d37-0dc6d222a2b9

For me, it looks like there is no change on reported numbers and/or the alert. Perhaps I misunderstood what to do?

Kind regards,

aanno

Am 13.12.23 um 05:05 schrieb stratis-devel-request@lists.fedorahosted.org:

Send stratis-devel mailing list submissions to
	stratis-devel@lists.fedorahosted.org

To subscribe or unsubscribe via email, send a message with subject or
body 'help' to
	stratis-devel-request@lists.fedorahosted.org

You can reach the person managing the list at
	stratis-devel-owner@lists.fedorahosted.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of stratis-devel digest..."

Today's Topics:

   1. Re: stratis: fs exhausted? (John Baublitz)


----------------------------------------------------------------------

Date: Tue, 12 Dec 2023 17:57:53 -0500
From: John Baublitz <jbaublit@redhat.com>
Subject: [stratis-devel] Re: stratis: fs exhausted?
To: aanno <aannoaanno@gmail.com>
Cc: stratis-devel@lists.fedorahosted.org
Message-ID:
	<CANPnS0=GeO7FUb5EJpL1_2OAKVULMNFhP=efvwfNWCms83WZAg@mail.gmail.com>
Content-Type: multipart/alternative;
	boundary="000000000000b6b959060c57fb18"

--000000000000b6b959060c57fb18
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi aanno,
I would also like to just mention that when you say the physical space is
exhausted, I'm assuming you're referring to alert WS001, correct? We may
need to document this a little bit better because this alert just means
that all of the space in the pool is fully allocated. This alert
specifically pops up when:

1. The pool extends to take up all available physical space (this will not
set the warning you are seeing).
2. You fill up the remaining space to the point where only 15 GiB is left.
3. The pool attempts to extend the data device further and determines there
is no space left to extend (this is when the warning is set).

Now practically what this means is that when the warning is set, you have
15GiB left of space. If you fill up the 15GiB, the pool will not be able to
be extended further to help you out. What I'm mostly curious about is,
looking at the space you reported in stratis pool/fs it looks like the
physical space on the pool is not full enough to warrant the alert. Is this
output after deleting a significant amount of data from the pool? From what
I can see, you shouldn't have this alert set unless your usage spiked
significantly and went back down. The warning doesn't clear out unless you
add more space so the state you're in is not impossible or even unlikely,
but it does make me wonder a little bit about your usage pattern. Are you
still seeing this instability even with the lower usage you pasted here?

On Thu, Dec 7, 2023 at 1:37=E2=80=AFPM aanno <aannoaanno@gmail.com> wrote:

Hello,

I'm using stratis for many years now (for my /home and /opt mount points)=
.
It looks like this:

$ stratis pool
Name                         Total / Used / Free    Properties
                                  UUID   Alerts
stratis_hdd   1.43 TiB / 819.51 GiB / 645.32 GiB    Ca,~Cr, Op
  093c8d42-21b8-46a2-a7e8-5d35f458fa58   WS001

$ stratis fs
Pool          Filesystem   Total / Used / Free / Limit
             Created             Device                          UUID

stratis_hdd   home         2 TiB / 708.92 GiB / 1.31 TiB / None     Apr 2=
8
2019 12:29   /dev/stratis/stratis_hdd/home   1715
5095-e225-4fb0-b020-ec2ffa6a5e4d
stratis_hdd   opt          1 TiB / 109.11 GiB / 914.89 GiB / None   Apr 2=
8
2019 12:30   /dev/stratis/stratis_hdd/opt    fb19
a29e-ab39-4b41-8d37-0dc6d222a2b9

$ stratis blockdev
Pool Name     Device Node   Physical Size    Tier   UUID

stratis_hdd   /dev/dm-6        292.95 GiB   CACHE
  770d0190-c17b-4349-a9f9-0968036e6b2c
stratis_hdd   /dev/dm-7          1.43 TiB    DATA
  9a5b1c4d-8014-4155-990e-eedfd27803a6

However, since a few weeks my /home has become unstable. Newly created (o=
r
altered) files are (sometimes) corrupted after a reboot of the system.

For both mount points I'm using a SSD cache in front of a HDD. It feels a
bit like the caching layer is all right, but the HDD layer is on error
(exhausted?). For me, it looks like that would explain the observed
behaviour.

I wonder if

* I could somehow 'disable' (or remove) the SSD caching layer?
* I could get some debug informations?

Kind regards,

aanno

--
_______________________________________________
stratis-devel mailing list -- stratis-devel@lists.fedorahosted.org
To unsubscribe send an email to stratis-devel-leave@lists.fedorahosted.or=
g
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedorahosted.org/archives/list/stratis-devel@lists.fedoraho=
sted.org
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue


--=20
John
he/him
Principal Software Engineer, Stratis team

--000000000000b6b959060c57fb18
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div>Hi aanno,</div><div>I would also lik=
e to just mention that when you say the physical space is exhausted, I&#39;=
m assuming you&#39;re referring to alert WS001, correct? We may need to doc=
ument this a little bit better because this alert just means that all of th=
e space in the pool is fully allocated. This alert specifically pops up whe=
n:</div><div><br></div><div>1. The pool extends to take up all available ph=
ysical space (this will not set the warning you are seeing).</div><div>2. Y=
ou fill up the remaining space to the point where only 15 GiB is left.</div=
<div>3. The pool attempts to extend the data device further and determines=
 there is no space left to extend (this is when the warning is set).<br></d=
iv><div><br></div><div>Now practically what this means is that when the war=
ning is set, you have 15GiB left of space. If you fill up the 15GiB, the po=
ol will not be able to be extended further to help you out. What I&#39;m mo=
stly curious about is, looking at the space you reported in stratis pool/fs=
 it looks like the physical space on the pool is not full enough to warrant=
 the alert. Is this output after deleting a significant amount of data from=
 the pool? From what I can see, you shouldn&#39;t have this alert set unles=
s your usage spiked significantly and went back down. The warning doesn&#39=
;t clear out unless you add more space so the state you&#39;re in is not im=
possible or even unlikely, but it does make me wonder a little bit about yo=
ur usage pattern. Are you still seeing this instability even with the lower=
 usage you pasted here?<br></div></div><br><div class=3D"gmail_quote"><div =
dir=3D"ltr" class=3D"gmail_attr">On Thu, Dec 7, 2023 at 1:37=E2=80=AFPM aan=
no &lt;<a href=3D"mailto:aannoaanno@gmail.com">aannoaanno@gmail.com</a>&gt;=
 wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px =
0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><u></u>

 =20

   =20
 =20
  <div>
    <p>Hello,</p>
    <p>I&#39;m using stratis for many years now (for my /home and /opt moun=
t
      points). It looks like this:</p>
    <p><span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0=
);background-color:rgb(255,255,255)">$ stratis pool
        </span><br>
        Name =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0Total / Used / Free =C2=A0=C2=A0=C2=A0Properties
        =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0UUID =C2=A0=
=C2=A0Alerts
        <br>
        stratis_hdd =C2=A0=C2=A01.43 TiB / 819.51 GiB / 645.32 GiB =C2=A0=
=C2=A0=C2=A0Ca,~Cr, Op
        =C2=A0=C2=A0093c8d42-21b8-46a2-a7e8-5d35f458fa58 =C2=A0=C2=A0WS001 =
<br>
        <br>
      </span><span style=3D"font-family:monospace"></span></p>
    <p><span style=3D"font-family:monospace"><span style=3D"color:rgb(0,0,0=
);background-color:rgb(255,255,255)">$ stratis fs
        </span><br>
        Pool =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Filesyst=
em =C2=A0=C2=A0Total / Used / Free / Limit
        =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0Created =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0Device
        =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0UUID<br>
        =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
        stratis_hdd =C2=A0=C2=A0home =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A02 TiB / 708.92 GiB / 1.31 TiB / None
        =C2=A0=C2=A0=C2=A0=C2=A0Apr 28 2019 12:29 =C2=A0=C2=A0/dev/stratis/=
stratis_hdd/home =C2=A0=C2=A01715<br>
        5095-e225-4fb0-b020-ec2ffa6a5e4d
        <br>
        stratis_hdd =C2=A0=C2=A0opt =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A01 TiB / 109.11 GiB / 914.89 GiB /
        None =C2=A0=C2=A0Apr 28 2019 12:30 =C2=A0=C2=A0/dev/stratis/stratis=
_hdd/opt =C2=A0=C2=A0=C2=A0fb19<br>
        a29e-ab39-4b41-8d37-0dc6d222a2b9<br>
        <br>
      </span></p>
    <p><span style=3D"font-family:monospace"></span><span style=3D"font-fam=
ily:monospace"><span style=3D"color:rgb(0,0,0);background-color:rgb(255,255=
,255)">$ stratis
          blockdev
        </span><br>
        Pool Name =C2=A0=C2=A0=C2=A0=C2=A0Device Node =C2=A0=C2=A0Physical =
Size =C2=A0=C2=A0=C2=A0Tier =C2=A0=C2=A0UUID
        =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
        stratis_hdd =C2=A0=C2=A0/dev/dm-6 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0292.95 GiB =C2=A0=C2=A0CACHE
        =C2=A0=C2=A0770d0190-c17b-4349-a9f9-0968036e6b2c
        <br>
        stratis_hdd =C2=A0=C2=A0/dev/dm-7 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A01.43 TiB =C2=A0=C2=A0=C2=A0DATA
        =C2=A0=C2=A09a5b1c4d-8014-4155-990e-eedfd27803a6<br>
      </span><br>
    </p>
    <p>However, since a few weeks my /home has become unstable. Newly
      created (or altered) files are (sometimes) corrupted after a
      reboot of the system.</p>
    <p>For both mount points I&#39;m using a SSD cache in front of a HDD. I=
t
      feels a bit like the caching layer is all right, but the HDD layer
      is on error (exhausted?). For me, it looks like that would explain
      the observed behaviour.</p>
    <p>I wonder if</p>
    <p>* I could somehow &#39;disable&#39; (or remove) the SSD caching laye=
r?<br>
      * I could get some debug informations?<br>
    </p>
    <p>Kind regards,</p>
    <p>aanno<br>
    </p>
    <p><span style=3D"font-family:monospace"></span></p>
  </div>

--<br>
_______________________________________________<br>
stratis-devel mailing list -- <a href=3D"mailto:stratis-devel@lists.fedorah=
osted.org" target=3D"_blank">stratis-devel@lists.fedorahosted.org</a><br>
To unsubscribe send an email to <a href=3D"mailto:stratis-devel-leave@lists=
.fedorahosted.org" target=3D"_blank">stratis-devel-leave@lists.fedorahosted=
.org</a><br>
Fedora Code of Conduct: <a href=3D"https://docs.fedoraproject.org/en-US/pro=
ject/code-of-conduct/" rel=3D"noreferrer" target=3D"_blank">https://docs.fe=
doraproject.org/en-US/project/code-of-conduct/</a><br>
List Guidelines: <a href=3D"https://fedoraproject.org/wiki/Mailing_list_gui=
delines" rel=3D"noreferrer" target=3D"_blank">https://fedoraproject.org/wik=
i/Mailing_list_guidelines</a><br>
List Archives: <a href=3D"https://lists.fedorahosted.org/archives/list/stra=
tis-devel@lists.fedorahosted.org" rel=3D"noreferrer" target=3D"_blank">http=
s://lists.fedorahosted.org/archives/list/stratis-devel@lists.fedorahosted.o=
rg</a><br>
Do not reply to spam, report it: <a href=3D"https://pagure.io/fedora-infras=
tructure/new_issue" rel=3D"noreferrer" target=3D"_blank">https://pagure.io/=
fedora-infrastructure/new_issue</a><br>
</blockquote></div><br clear=3D"all"><br><span class=3D"gmail_signature_pre=
fix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"l=
tr">John<br>he/him<br>Principal Software Engineer, Stratis team</div></div>=
</div>

--000000000000b6b959060c57fb18--

------------------------------

Subject: Digest Footer

--
_______________________________________________
stratis-devel mailing list -- stratis-devel@lists.fedorahosted.org
To unsubscribe send an email to stratis-devel-leave@lists.fedorahosted.org
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedorahosted.org/archives/list/stratis-devel@lists.fedorahosted.org
Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue


------------------------------

End of stratis-devel Digest, Vol 47, Issue 2
********************************************