How long will the logs be kept?

How long will the logs be kept?

[Wukongming]

Hi ,All
        Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?

---------------------------------------------
wukongming ID: 12019
Tel：0571-86760239
Dept：2014 UIS2 OneStor

-------------------------------------------------------------------------------------------------------------------------------------
本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
邮件！
This e-mail and its attachments contain confidential information from H3C, which is
intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender
by phone or email immediately and delete it!

Re: How long will the logs be kept?

[huang jun]

it will rotate every week by default, you can see the logrotate file
/etc/ceph/logrotate.d/ceph

2015-12-03 12:37 GMT+08:00 Wukongming <wu.kongming@h3c.com>:
> Hi ,All
>         Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?
>
> ---------------------------------------------
> wukongming ID: 12019
> Tel：0571-86760239
> Dept：2014 UIS2 OneStor
>
> -------------------------------------------------------------------------------------------------------------------------------------
> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
> 邮件！
> This e-mail and its attachments contain confidential information from H3C, which is
> intended only for the person or entity whose address is listed above. Any use of the
> information contained herein in any way (including, but not limited to, total or partial
> disclosure, reproduction, or dissemination) by persons other than the intended
> recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!



-- 
thanks
huangjun

答复: How long will the logs be kept?

[Wukongming]

Yes, I can find ceph of rotate configure file in the directory of /etc/logrotate.d. 
Also, I find sth. Weird.

drwxr-xr-x  2 root root   4.0K Dec  3 14:54 ./
drwxrwxr-x 19 root syslog 4.0K Dec  3 13:33 ../
-rw-------  1 root root      0 Dec  2 06:25 ceph.audit.log
-rw-------  1 root root    85K Nov 25 09:17 ceph.audit.log.1.gz
-rw-------  1 root root   228K Dec  3 16:00 ceph.log
-rw-------  1 root root    28K Dec  3 06:23 ceph.log.1.gz
-rw-------  1 root root   374K Dec  2 06:22 ceph.log.2.gz
-rw-r--r--  1 root root   4.3M Dec  3 16:01 ceph-mon.wkm01.log
-rw-r--r--  1 root root   561K Dec  3 06:25 ceph-mon.wkm01.log.1.gz
-rw-r--r--  1 root root   2.2M Dec  2 06:25 ceph-mon.wkm01.log.2.gz
-rw-r--r--  1 root root      0 Dec  2 06:25 ceph-osd.0.log
-rw-r--r--  1 root root    992 Dec  1 09:09 ceph-osd.0.log.1.gz
-rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.2.log
-rw-r--r--  1 root root   2.3K Dec  2 10:50 ceph-osd.2.log.1.gz
-rw-r--r--  1 root root    27K Dec  1 10:31 ceph-osd.2.log.2.gz
-rw-r--r--  1 root root    13K Dec  3 10:23 ceph-osd.5.log
-rw-r--r--  1 root root   1.6K Dec  2 09:57 ceph-osd.5.log.1.gz
-rw-r--r--  1 root root    22K Dec  1 09:51 ceph-osd.5.log.2.gz
-rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.8.log
-rw-r--r--  1 root root    18K Dec  2 10:50 ceph-osd.8.log.1
-rw-r--r--  1 root root   261K Dec  1 13:54 ceph-osd.8.log.2

I deployed ceph cluster on Nov 21, from that day to Dec.1, I mean the continue 10 days' logs were compressed into one file, it is not what I want.
Does any OP affect log compressing?

Thanks!
            Kongming Wu
---------------------------------------------
wukongming ID: 12019
Tel：0571-86760239
Dept：2014 UIS2 ONEStor

-----邮件原件-----
发件人: huang jun [mailto:hjwsm1989@gmail.com] 
发送时间: 2015年12月3日 13:19
收件人: wukongming 12019 (RD)
抄送: ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
主题: Re: How long will the logs be kept?

it will rotate every week by default, you can see the logrotate file /etc/ceph/logrotate.d/ceph

2015-12-03 12:37 GMT+08:00 Wukongming <wu.kongming@h3c.com>:
> Hi ,All
>         Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?
>
> ---------------------------------------------
> wukongming ID: 12019
> Tel：0571-86760239
> Dept：2014 UIS2 OneStor
>
> ----------------------------------------------------------------------
> ---------------------------------------------------------------
> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
> 邮件！
> This e-mail and its attachments contain confidential information from 
> H3C, which is intended only for the person or entity whose address is 
> listed above. Any use of the information contained herein in any way 
> (including, but not limited to, total or partial disclosure, 
> reproduction, or dissemination) by persons other than the intended
> recipient(s) is prohibited. If you receive this e-mail in error, 
> please notify the sender by phone or email immediately and delete it!



--
thanks
huangjun

Re: [ceph-users] How long will the logs be kept?

[Jan Schermer]

You can setup logrotate however you want - not sure what the default is for your distro.
Usually logrotate doesn't touch files that are smaller than some size even if they are old. It will also not delete logs for OSDs that no longer exist. 

Ceph itself has nothing to do with log rotation, logrotate does the work. Ceph packages likely contain default logrotate rules for the logs but you can edit them to your liking.

Jan

> On 03 Dec 2015, at 09:38, Wukongming <wu.kongming@h3c.com> wrote:
> 
> Yes, I can find ceph of rotate configure file in the directory of /etc/logrotate.d. 
> Also, I find sth. Weird.
> 
> drwxr-xr-x  2 root root   4.0K Dec  3 14:54 ./
> drwxrwxr-x 19 root syslog 4.0K Dec  3 13:33 ../
> -rw-------  1 root root      0 Dec  2 06:25 ceph.audit.log
> -rw-------  1 root root    85K Nov 25 09:17 ceph.audit.log.1.gz
> -rw-------  1 root root   228K Dec  3 16:00 ceph.log
> -rw-------  1 root root    28K Dec  3 06:23 ceph.log.1.gz
> -rw-------  1 root root   374K Dec  2 06:22 ceph.log.2.gz
> -rw-r--r--  1 root root   4.3M Dec  3 16:01 ceph-mon.wkm01.log
> -rw-r--r--  1 root root   561K Dec  3 06:25 ceph-mon.wkm01.log.1.gz
> -rw-r--r--  1 root root   2.2M Dec  2 06:25 ceph-mon.wkm01.log.2.gz
> -rw-r--r--  1 root root      0 Dec  2 06:25 ceph-osd.0.log
> -rw-r--r--  1 root root    992 Dec  1 09:09 ceph-osd.0.log.1.gz
> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.2.log
> -rw-r--r--  1 root root   2.3K Dec  2 10:50 ceph-osd.2.log.1.gz
> -rw-r--r--  1 root root    27K Dec  1 10:31 ceph-osd.2.log.2.gz
> -rw-r--r--  1 root root    13K Dec  3 10:23 ceph-osd.5.log
> -rw-r--r--  1 root root   1.6K Dec  2 09:57 ceph-osd.5.log.1.gz
> -rw-r--r--  1 root root    22K Dec  1 09:51 ceph-osd.5.log.2.gz
> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.8.log
> -rw-r--r--  1 root root    18K Dec  2 10:50 ceph-osd.8.log.1
> -rw-r--r--  1 root root   261K Dec  1 13:54 ceph-osd.8.log.2
> 
> I deployed ceph cluster on Nov 21, from that day to Dec.1, I mean the continue 10 days' logs were compressed into one file, it is not what I want.
> Does any OP affect log compressing?
> 
> Thanks!
>            Kongming Wu
> ---------------------------------------------
> wukongming ID: 12019
> Tel：0571-86760239
> Dept：2014 UIS2 ONEStor
> 
> -----邮件原件-----
> 发件人: huang jun [mailto:hjwsm1989@gmail.com] 
> 发送时间: 2015年12月3日 13:19
> 收件人: wukongming 12019 (RD)
> 抄送: ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
> 主题: Re: How long will the logs be kept?
> 
> it will rotate every week by default, you can see the logrotate file /etc/ceph/logrotate.d/ceph
> 
> 2015-12-03 12:37 GMT+08:00 Wukongming <wu.kongming@h3c.com>:
>> Hi ,All
>>        Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?
>> 
>> ---------------------------------------------
>> wukongming ID: 12019
>> Tel：0571-86760239
>> Dept：2014 UIS2 OneStor
>> 
>> ----------------------------------------------------------------------
>> ---------------------------------------------------------------
>> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
>> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
>> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
>> 邮件！
>> This e-mail and its attachments contain confidential information from 
>> H3C, which is intended only for the person or entity whose address is 
>> listed above. Any use of the information contained herein in any way 
>> (including, but not limited to, total or partial disclosure, 
>> reproduction, or dissemination) by persons other than the intended
>> recipient(s) is prohibited. If you receive this e-mail in error, 
>> please notify the sender by phone or email immediately and delete it!
> 
> 
> 
> --
> thanks
> huangjun
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

答复: How long will the logs be kept?

[Wukongming]

OK! One more question. Do you know why ceph has 2 ways outputting logs(dout && clog). Cause I find dout is more helpful than clog, Did ceph use clog first, and dout added for new version?

---------------------------------------------
wukongming ID: 12019
Tel：0571-86760239
Dept：2014 UIS2 ONEStor

-----邮件原件-----
发件人: Jan Schermer [mailto:jan@schermer.cz] 
发送时间: 2015年12月3日 16:58
收件人: wukongming 12019 (RD)
抄送: huang jun; ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
主题: Re: [ceph-users] How long will the logs be kept?

You can setup logrotate however you want - not sure what the default is for your distro.
Usually logrotate doesn't touch files that are smaller than some size even if they are old. It will also not delete logs for OSDs that no longer exist. 

Ceph itself has nothing to do with log rotation, logrotate does the work. Ceph packages likely contain default logrotate rules for the logs but you can edit them to your liking.

Jan

> On 03 Dec 2015, at 09:38, Wukongming <wu.kongming@h3c.com> wrote:
> 
> Yes, I can find ceph of rotate configure file in the directory of /etc/logrotate.d. 
> Also, I find sth. Weird.
> 
> drwxr-xr-x  2 root root   4.0K Dec  3 14:54 ./
> drwxrwxr-x 19 root syslog 4.0K Dec  3 13:33 ../
> -rw-------  1 root root      0 Dec  2 06:25 ceph.audit.log
> -rw-------  1 root root    85K Nov 25 09:17 ceph.audit.log.1.gz
> -rw-------  1 root root   228K Dec  3 16:00 ceph.log
> -rw-------  1 root root    28K Dec  3 06:23 ceph.log.1.gz
> -rw-------  1 root root   374K Dec  2 06:22 ceph.log.2.gz
> -rw-r--r--  1 root root   4.3M Dec  3 16:01 ceph-mon.wkm01.log
> -rw-r--r--  1 root root   561K Dec  3 06:25 ceph-mon.wkm01.log.1.gz
> -rw-r--r--  1 root root   2.2M Dec  2 06:25 ceph-mon.wkm01.log.2.gz
> -rw-r--r--  1 root root      0 Dec  2 06:25 ceph-osd.0.log
> -rw-r--r--  1 root root    992 Dec  1 09:09 ceph-osd.0.log.1.gz
> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.2.log
> -rw-r--r--  1 root root   2.3K Dec  2 10:50 ceph-osd.2.log.1.gz
> -rw-r--r--  1 root root    27K Dec  1 10:31 ceph-osd.2.log.2.gz
> -rw-r--r--  1 root root    13K Dec  3 10:23 ceph-osd.5.log
> -rw-r--r--  1 root root   1.6K Dec  2 09:57 ceph-osd.5.log.1.gz
> -rw-r--r--  1 root root    22K Dec  1 09:51 ceph-osd.5.log.2.gz
> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.8.log
> -rw-r--r--  1 root root    18K Dec  2 10:50 ceph-osd.8.log.1
> -rw-r--r--  1 root root   261K Dec  1 13:54 ceph-osd.8.log.2
> 
> I deployed ceph cluster on Nov 21, from that day to Dec.1, I mean the continue 10 days' logs were compressed into one file, it is not what I want.
> Does any OP affect log compressing?
> 
> Thanks!
>            Kongming Wu
> ---------------------------------------------
> wukongming ID: 12019
> Tel：0571-86760239
> Dept：2014 UIS2 ONEStor
> 
> -----邮件原件-----
> 发件人: huang jun [mailto:hjwsm1989@gmail.com]
> 发送时间: 2015年12月3日 13:19
> 收件人: wukongming 12019 (RD)
> 抄送: ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
> 主题: Re: How long will the logs be kept?
> 
> it will rotate every week by default, you can see the logrotate file 
> /etc/ceph/logrotate.d/ceph
> 
> 2015-12-03 12:37 GMT+08:00 Wukongming <wu.kongming@h3c.com>:
>> Hi ,All
>>        Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?
>> 
>> ---------------------------------------------
>> wukongming ID: 12019
>> Tel：0571-86760239
>> Dept：2014 UIS2 OneStor
>> 
>> ---------------------------------------------------------------------
>> -
>> ---------------------------------------------------------------
>> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
>> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
>> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
>> 邮件！
>> This e-mail and its attachments contain confidential information from 
>> H3C, which is intended only for the person or entity whose address is 
>> listed above. Any use of the information contained herein in any way 
>> (including, but not limited to, total or partial disclosure, 
>> reproduction, or dissemination) by persons other than the intended
>> recipient(s) is prohibited. If you receive this e-mail in error, 
>> please notify the sender by phone or email immediately and delete it!
> 
> 
> 
> --
> thanks
> huangjun
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: 答复: How long will the logs be kept?

[Sage Weil]

On Thu, 3 Dec 2015, Wukongming wrote:
> OK! One more question. Do you know why ceph has 2 ways outputting 
> logs(dout && clog). Cause I find dout is more helpful than clog, Did 
> ceph use clog first, and dout added for new version?

clog is the 'cluster log', that gets aggregated into a single log stream 
and replicated on each monitor (normally /var/log/ceph/ceph.log). It's for 
high-level events of interest to the entire cluster.  The intended 
consumer is the system administrator.

dout is for debugging a single process.  It's used by a developer (or a 
savvy admin).

sage

Re: 答复: How long will the logs be kept?

[David Zafman]

dout() is used for an OSD to log information about what it is doing 
locally and might become very chatty.  It is saved on the local nodes 
disk only.

clog is the cluster log and is used for major events that should be 
known by the administrator (see ceph -w).  Clog should be used sparingly 
as it sends the messages to the monitor.

David

On 12/3/15 4:36 AM, Wukongming wrote:
> OK! One more question. Do you know why ceph has 2 ways outputting logs(dout && clog). Cause I find dout is more helpful than clog, Did ceph use clog first, and dout added for new version?
>
> ---------------------------------------------
> wukongming ID: 12019
> Tel：0571-86760239
> Dept：2014 UIS2 ONEStor
>
> -----邮件原件-----
> 发件人: Jan Schermer [mailto:jan@schermer.cz]
> 发送时间: 2015年12月3日 16:58
> 收件人: wukongming 12019 (RD)
> 抄送: huang jun; ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
> 主题: Re: [ceph-users] How long will the logs be kept?
>
> You can setup logrotate however you want - not sure what the default is for your distro.
> Usually logrotate doesn't touch files that are smaller than some size even if they are old. It will also not delete logs for OSDs that no longer exist.
>
> Ceph itself has nothing to do with log rotation, logrotate does the work. Ceph packages likely contain default logrotate rules for the logs but you can edit them to your liking.
>
> Jan
>
>> On 03 Dec 2015, at 09:38, Wukongming <wu.kongming@h3c.com> wrote:
>>
>> Yes, I can find ceph of rotate configure file in the directory of /etc/logrotate.d.
>> Also, I find sth. Weird.
>>
>> drwxr-xr-x  2 root root   4.0K Dec  3 14:54 ./
>> drwxrwxr-x 19 root syslog 4.0K Dec  3 13:33 ../
>> -rw-------  1 root root      0 Dec  2 06:25 ceph.audit.log
>> -rw-------  1 root root    85K Nov 25 09:17 ceph.audit.log.1.gz
>> -rw-------  1 root root   228K Dec  3 16:00 ceph.log
>> -rw-------  1 root root    28K Dec  3 06:23 ceph.log.1.gz
>> -rw-------  1 root root   374K Dec  2 06:22 ceph.log.2.gz
>> -rw-r--r--  1 root root   4.3M Dec  3 16:01 ceph-mon.wkm01.log
>> -rw-r--r--  1 root root   561K Dec  3 06:25 ceph-mon.wkm01.log.1.gz
>> -rw-r--r--  1 root root   2.2M Dec  2 06:25 ceph-mon.wkm01.log.2.gz
>> -rw-r--r--  1 root root      0 Dec  2 06:25 ceph-osd.0.log
>> -rw-r--r--  1 root root    992 Dec  1 09:09 ceph-osd.0.log.1.gz
>> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.2.log
>> -rw-r--r--  1 root root   2.3K Dec  2 10:50 ceph-osd.2.log.1.gz
>> -rw-r--r--  1 root root    27K Dec  1 10:31 ceph-osd.2.log.2.gz
>> -rw-r--r--  1 root root    13K Dec  3 10:23 ceph-osd.5.log
>> -rw-r--r--  1 root root   1.6K Dec  2 09:57 ceph-osd.5.log.1.gz
>> -rw-r--r--  1 root root    22K Dec  1 09:51 ceph-osd.5.log.2.gz
>> -rw-r--r--  1 root root    19K Dec  3 10:51 ceph-osd.8.log
>> -rw-r--r--  1 root root    18K Dec  2 10:50 ceph-osd.8.log.1
>> -rw-r--r--  1 root root   261K Dec  1 13:54 ceph-osd.8.log.2
>>
>> I deployed ceph cluster on Nov 21, from that day to Dec.1, I mean the continue 10 days' logs were compressed into one file, it is not what I want.
>> Does any OP affect log compressing?
>>
>> Thanks!
>>             Kongming Wu
>> ---------------------------------------------
>> wukongming ID: 12019
>> Tel：0571-86760239
>> Dept：2014 UIS2 ONEStor
>>
>> -----邮件原件-----
>> 发件人: huang jun [mailto:hjwsm1989@gmail.com]
>> 发送时间: 2015年12月3日 13:19
>> 收件人: wukongming 12019 (RD)
>> 抄送: ceph-devel@vger.kernel.org; ceph-users@lists.ceph.com
>> 主题: Re: How long will the logs be kept?
>>
>> it will rotate every week by default, you can see the logrotate file
>> /etc/ceph/logrotate.d/ceph
>>
>> 2015-12-03 12:37 GMT+08:00 Wukongming <wu.kongming@h3c.com>:
>>> Hi ,All
>>>         Is there anyone who knows How long or how many days will the logs.gz (mon/osd/mds)be kept, maybe before flushed?
>>>
>>> ---------------------------------------------
>>> wukongming ID: 12019
>>> Tel：0571-86760239
>>> Dept：2014 UIS2 OneStor
>>>
>>> ---------------------------------------------------------------------
>>> -
>>> ---------------------------------------------------------------
>>> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
>>> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
>>> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
>>> 邮件！
>>> This e-mail and its attachments contain confidential information from
>>> H3C, which is intended only for the person or entity whose address is
>>> listed above. Any use of the information contained herein in any way
>>> (including, but not limited to, total or partial disclosure,
>>> reproduction, or dissemination) by persons other than the intended
>>> recipient(s) is prohibited. If you receive this e-mail in error,
>>> please notify the sender by phone or email immediately and delete it!
>>
>>
>> --
>> thanks
>> huangjun
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> N�����r��y���b�X��ǧv�^�)޺{.n�+���z�]z���{ay�\x1dʇڙ�,j\a��f���h���z�\x1e�w���\f���j:+v���w�j�m����\a����zZ+�����ݢj"��!tml=

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com