Armadillo-Box WS1/fluentd
[
Front page
] [
New
|
List of pages
|
Search
|
Recent changes
]
Start:
[[labs.beatcraft.com]]~
[[Armadillo]]~
[[Armadillo-Box WS1/BLE Gateway]]~
#contents
* Armadillo-Box WS1/fluentd [#mb99aa44]
>
The kernel and UserLand of Armadillo-Box WS1 are similar ...
~
This article explains how to implement fluentd on Armadil...
** Format of the collected data [#ba18d425]
>
The collected data is collected by a specific application...
Nov 30 15:00:43 (none) user.info tempgw: ADV: E0:40:56:7...
~
These data are read by tail plugin of fluentd. The read d...
** Adding fluentd [#q8df8c31]
>
Add the fluentd related files to atmark dist by make menu...
Select vender/Product.~
(AtmarkTechno) Vendor
(Armadillo-Box WS1) AtmarkTechno Products
~
Configuring UserLand, activate fluented and the requireme...
[*] Customize Vendor/User Settings (NEW)
Miscellaneous Applications --->
:
:
--- extension
:
:
[*] ruby <-- Put the checkmark ...
(2.1.2) Version <-- Choose 2.1.2. If s...
[*] fluentd <-- If ruby is selecte...
:
[*] http_parser.rb <-- If ruby is selecte...
[*] ruby-cool.io <-- If ruby is selecte...
:
[*] ruby-macaddr <-- If ruby is selecte...
:
[*] ruby-sigdump <-- If ruby is selecte...
[*] ruby-systemu <-- If ruby is selecte...
[*] ruby-string-scrub <-- If ruby is selecte...
[*] ruby-thread_safe <-- If ruby is selecte...
[*] ruby-tzinfo <-- If ruby is selecte...
[*] ruby-tzinfo-data <-- If ruby is selecte...
:
[*] msgpack-ruby <-- If ruby is selecte...
:
[*] yajl-ruby <-- If ruby is selecte...
:
:
:
** Building kernel and UserLand [#y7811c2b]
>
With the configuration above, build kernel and UserLand.~
atmark@atde5:~/atmark-dist$ make clean
atmark@atde5:~/atmark-dist$ make
**Placing fluent.conf [#qfcf0448]
>
Create a directory for fluentd at /etc of ROM image direc...
~
However, the feature of atmark dist, which is booted by r...
atmark@atde5:~/atmark-dist$ cd romfs/etc
atmark@atde5:~/atmark-dist/romfs/etc$ mkdir fluent
atmark@atde5:~/atmark-dist/romfs/etc$ cd fluent
atmark@atde5:~/atmark-dist/romfs/etc/fluent$ ln -s /etc/...
~
Also, the configuration files located below /etc/default/...
atmark@atde5:~/atmark-dist/romfs/etc/fluent$ cd ../defau...
atmark@atde5:~/atmark-dist/romfs/etc/default$ cp ~/atmar...
** Rebuilding image [#i26eb2ab]
>
As the placement of fluent.conf is completed, the image o...
atmark@atde5:~$ cd atmark-dist
atmark@atde5:~/atmark-dist$ make image
** Checking the operation [#y33926fe]
>
If Armadillo-Box WS1 is connected to a network, the faste...
hermit> tftpdl 192.168.0.90 192.168.0.164 --blksize=1024...
hermit> tftpdl 192.168.0.90 192.168.0.164 --blksize=1024...
~
If Armadillo-Box WS1 is booted and connected to the netwo...
[root@abws1-0 (ttymxc1) ~]# ntpclient -h ntp.nict.jp -s
25567 00180.848 8769.0 0.8 1448951602547493.0 ...
[root@abws1-0 (ttymxc1) ~]# date
Tue Nov 25 15:36:24 JST 2015
~
Change the contents of fluent.conf to ones shown below.
<source>
@type tail
format /^(?<time>[^ ]* [^ ]* [^ ]*) (?<host>[^ ]*) (?<...
time_format %b %d %H:%M:%S
path /var/log/messages
pos_file /var/tmp/mesagges.pos
types temp:float
tag syslog.ble
</source>
<match syslog.**>
@type copy
<store>
@type forward
heartbeat_interval 60s
heartbeat_type tcp
flush_interval 60s ##600s at realuse
buffer_type file
buffer_path /var/tmp/in_ble_app.syslog.*.buffer
buffer_chunk_limit 3072k
buffer_queue_limit 425
retry_wait 2s
max_retry_wait 1h
retry_limit 72 # retry count
<server>
host 192.168.0.80
port 24224
</server>
</store>
<store>
type stdout
</store>
</match>
~
Execute fluentd with the debug option at the foreground.~
[root@abws1-0 (ttymxc1) ~]# fluentd -c /etc/fluent/fluen...
2015-11-25 16:09:28 +0900 [info]: fluent/supervisor.rb:3...
2015-11-25 16:09:29 +0900 [info]: fluent/supervisor.rb:2...
2015-11-25 16:09:30 +0900 [trace]: fluent/plugin.rb:98:r...
2015-11-25 16:09:30 +0900 [trace]: fluent/plugin.rb:98:r...
~~ Skipping~~
2015-12-01 16:09:37 +0900 [info]: fluent/agent.rb:123:ad...
2015-12-01 16:09:37 +0900 [info]: fluent/root_agent.rb:1...
2015-12-01 16:09:37 +0900 [info]: plugin/in_tail.rb:474:...
2015-12-01 16:09:56 +0900 syslog.ble: {"host":"(none)","...
2015-12-01 16:10:56 +0900 syslog.ble: {"host":"(none)","...
2015-12-01 16:11:56 +0900 syslog.ble: {"host":"(none)","...
~
Please quit fluentd if the outputs to stdout are recogniz...
** Execution configuration for booting [#t50dfc86]
>
Add the configurations, which regulate the operation of f...
~
Please add the contents shown below to /etc/config.rc.loc...
#!/bin/sh
. /etc/init.d/functions
PATH=/bin:/sbin:/usr/bin:/usr/sbin
# ntp
ntpclient -h ntp.nict.jp -s
# BLE temperature log application
tempgw &
# fleuntd
fluentd -c /etc/fluent/fluent.conf -o /var/log/fluent.lo...
~
In this article, fluentd is directly executed in rc.local...
~
To boot fluentd from rc.local. Unlike execting on shell a...
The uncorrected timezone affects on the date of logs, whi...
** fluentd at the receiving side [#h503335e]
>
Applying the configurations above, the logs are sent by t...
About the configuration of log collecting server, please ...
* Revision History [#qbfccff1]
>
- 2015-12-08 This article is initially released.
End:
[[labs.beatcraft.com]]~
[[Armadillo]]~
[[Armadillo-Box WS1/BLE Gateway]]~
#contents
* Armadillo-Box WS1/fluentd [#mb99aa44]
>
The kernel and UserLand of Armadillo-Box WS1 are similar ...
~
This article explains how to implement fluentd on Armadil...
** Format of the collected data [#ba18d425]
>
The collected data is collected by a specific application...
Nov 30 15:00:43 (none) user.info tempgw: ADV: E0:40:56:7...
~
These data are read by tail plugin of fluentd. The read d...
** Adding fluentd [#q8df8c31]
>
Add the fluentd related files to atmark dist by make menu...
Select vender/Product.~
(AtmarkTechno) Vendor
(Armadillo-Box WS1) AtmarkTechno Products
~
Configuring UserLand, activate fluented and the requireme...
[*] Customize Vendor/User Settings (NEW)
Miscellaneous Applications --->
:
:
--- extension
:
:
[*] ruby <-- Put the checkmark ...
(2.1.2) Version <-- Choose 2.1.2. If s...
[*] fluentd <-- If ruby is selecte...
:
[*] http_parser.rb <-- If ruby is selecte...
[*] ruby-cool.io <-- If ruby is selecte...
:
[*] ruby-macaddr <-- If ruby is selecte...
:
[*] ruby-sigdump <-- If ruby is selecte...
[*] ruby-systemu <-- If ruby is selecte...
[*] ruby-string-scrub <-- If ruby is selecte...
[*] ruby-thread_safe <-- If ruby is selecte...
[*] ruby-tzinfo <-- If ruby is selecte...
[*] ruby-tzinfo-data <-- If ruby is selecte...
:
[*] msgpack-ruby <-- If ruby is selecte...
:
[*] yajl-ruby <-- If ruby is selecte...
:
:
:
** Building kernel and UserLand [#y7811c2b]
>
With the configuration above, build kernel and UserLand.~
atmark@atde5:~/atmark-dist$ make clean
atmark@atde5:~/atmark-dist$ make
**Placing fluent.conf [#qfcf0448]
>
Create a directory for fluentd at /etc of ROM image direc...
~
However, the feature of atmark dist, which is booted by r...
atmark@atde5:~/atmark-dist$ cd romfs/etc
atmark@atde5:~/atmark-dist/romfs/etc$ mkdir fluent
atmark@atde5:~/atmark-dist/romfs/etc$ cd fluent
atmark@atde5:~/atmark-dist/romfs/etc/fluent$ ln -s /etc/...
~
Also, the configuration files located below /etc/default/...
atmark@atde5:~/atmark-dist/romfs/etc/fluent$ cd ../defau...
atmark@atde5:~/atmark-dist/romfs/etc/default$ cp ~/atmar...
** Rebuilding image [#i26eb2ab]
>
As the placement of fluent.conf is completed, the image o...
atmark@atde5:~$ cd atmark-dist
atmark@atde5:~/atmark-dist$ make image
** Checking the operation [#y33926fe]
>
If Armadillo-Box WS1 is connected to a network, the faste...
hermit> tftpdl 192.168.0.90 192.168.0.164 --blksize=1024...
hermit> tftpdl 192.168.0.90 192.168.0.164 --blksize=1024...
~
If Armadillo-Box WS1 is booted and connected to the netwo...
[root@abws1-0 (ttymxc1) ~]# ntpclient -h ntp.nict.jp -s
25567 00180.848 8769.0 0.8 1448951602547493.0 ...
[root@abws1-0 (ttymxc1) ~]# date
Tue Nov 25 15:36:24 JST 2015
~
Change the contents of fluent.conf to ones shown below.
<source>
@type tail
format /^(?<time>[^ ]* [^ ]* [^ ]*) (?<host>[^ ]*) (?<...
time_format %b %d %H:%M:%S
path /var/log/messages
pos_file /var/tmp/mesagges.pos
types temp:float
tag syslog.ble
</source>
<match syslog.**>
@type copy
<store>
@type forward
heartbeat_interval 60s
heartbeat_type tcp
flush_interval 60s ##600s at realuse
buffer_type file
buffer_path /var/tmp/in_ble_app.syslog.*.buffer
buffer_chunk_limit 3072k
buffer_queue_limit 425
retry_wait 2s
max_retry_wait 1h
retry_limit 72 # retry count
<server>
host 192.168.0.80
port 24224
</server>
</store>
<store>
type stdout
</store>
</match>
~
Execute fluentd with the debug option at the foreground.~
[root@abws1-0 (ttymxc1) ~]# fluentd -c /etc/fluent/fluen...
2015-11-25 16:09:28 +0900 [info]: fluent/supervisor.rb:3...
2015-11-25 16:09:29 +0900 [info]: fluent/supervisor.rb:2...
2015-11-25 16:09:30 +0900 [trace]: fluent/plugin.rb:98:r...
2015-11-25 16:09:30 +0900 [trace]: fluent/plugin.rb:98:r...
~~ Skipping~~
2015-12-01 16:09:37 +0900 [info]: fluent/agent.rb:123:ad...
2015-12-01 16:09:37 +0900 [info]: fluent/root_agent.rb:1...
2015-12-01 16:09:37 +0900 [info]: plugin/in_tail.rb:474:...
2015-12-01 16:09:56 +0900 syslog.ble: {"host":"(none)","...
2015-12-01 16:10:56 +0900 syslog.ble: {"host":"(none)","...
2015-12-01 16:11:56 +0900 syslog.ble: {"host":"(none)","...
~
Please quit fluentd if the outputs to stdout are recogniz...
** Execution configuration for booting [#t50dfc86]
>
Add the configurations, which regulate the operation of f...
~
Please add the contents shown below to /etc/config.rc.loc...
#!/bin/sh
. /etc/init.d/functions
PATH=/bin:/sbin:/usr/bin:/usr/sbin
# ntp
ntpclient -h ntp.nict.jp -s
# BLE temperature log application
tempgw &
# fleuntd
fluentd -c /etc/fluent/fluent.conf -o /var/log/fluent.lo...
~
In this article, fluentd is directly executed in rc.local...
~
To boot fluentd from rc.local. Unlike execting on shell a...
The uncorrected timezone affects on the date of logs, whi...
** fluentd at the receiving side [#h503335e]
>
Applying the configurations above, the logs are sent by t...
About the configuration of log collecting server, please ...
* Revision History [#qbfccff1]
>
- 2015-12-08 This article is initially released.
Page: