System Monitoring with Xymon/Developer Guide
Getting Started with hobbit development on sourceforge
editReference Books
edit- C Programming
- UNIX Advance programming
- UNIX Network Programming
SVN tutorial
editReferences
editSVN for Xymon Tutorials
editFollowings are some examples using svn to interact with hobbit on sourceforge.net.
- list out the sub directory of xymon SVN directory.
[tjyang@ibm hobbitmon]$ svn ls https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon branches/ sandbox/ tags/ trunk/ [tjyang@ibm hobbitmon]$
- find out changes in last 7 days.
[tjyang@ibm hobbitmon]$ svn log -v -r HEAD:\{`date +%Y-%m-%d -d'7 days ago'`\} \ https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon ------------------------------------------------------------------------ r6033 | storner | 2009-01-08 07:43:23 -0600 (Thu, 08 Jan 2009) | 1 line Changed paths: M /trunk/client/Makefile Make sure client scripts are executable ------------------------------------------------------------------------ r6032 | storner | 2009-01-07 06:00:45 -0600 (Wed, 07 Jan 2009) | 1 line Changed paths: M /branches/4.2.3/build/md5.dat A /branches/4.2.3/hobbitd/webfiles/hostlist_footer A /branches/4.2.3/hobbitd/webfiles/hostlist_form A /branches/4.2.3/hobbitd/webfiles/hostlist_header M /branches/4.2.3/lib/headfoot.c M /branches/4.2.3/lib/headfoot.h M /branches/4.2.3/web/Makefile A /branches/4.2.3/web/hobbit-hostlist.c A /branches/4.2.3/web/hobbit-hostlist.sh.DIST Added hostlist CGI from trunk ------------------------------------------------------------------------ r6031 | storner | 2009-01-07 05:59:22 -0600 (Wed, 07 Jan 2009) | 2 lines Changed paths: M /branches/4.2.3/build/generate-md5.sh Adapted to work with Subversion and new source directories. ------------------------------------------------------------------------ r6030 | storner | 2008-12-17 05:39:49 -0600 (Wed, 17 Dec 2008) | 2 lines Changed paths: A /branches/4.2.3 (from /branches/4.2.2:6029) New branch off the 4.2.2 release for maintenance - will become 4.2.3 (if needed). ------------------------------------------------------------------------ [tjyang@ibm hobbitmon]$
- Checking out hobbit source tree using svn.
[tjyang@fc6 ]$ svn co https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon hobbitmon <snip> A hobbitmon/tags/rel_4_0-20041201/web/bb-findhost.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-ack.c A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc-trends.c A hobbitmon/tags/rel_4_0-20041201/web/bb-snapshot.c A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc.c A hobbitmon/tags/rel_4_0-20041201/web/bb-eventlog.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-rep.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-replog.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-hist.c A hobbitmon/tags/rel_4_0-20041201/web/bb-csvinfo.c A hobbitmon/tags/rel_4_0-20041201/web/bb-webpage.c Checked out revision 5644. [tjyang@fc6 hobbitmon]$ ls -la total 28 drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 09:11 . drwxr-xr-x 38 tjyang tjyang 4096 Aug 4 09:09 .. drwxrwxr-x 3 tjyang tjyang 4096 Aug 4 09:11 branches drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 10:04 .svn drwxrwxr-x 67 tjyang tjyang 4096 Aug 4 10:04 tags drwxrwxr-x 16 tjyang tjyang 4096 Aug 4 09:11 trunk [tjyang@fc6 hobbitmon]$ to revert all the changes you made to hobbit src tree. svn revert --recursive .
- As one of hobbit developers, you can create a branch.
- Following example create a instance of hobbit by tjyang.
[tjyang@fc6 hobbitmon]$ svn mkdir branches/tjyang A branches/tjyang [tjyang@fc6 hobbitmon]$ svn copy trunk branches/tjyang A branches/tjyang/trunk [tjyang@fc6 hobbitmon]$ svn commit -m "T.J. Yang's copy of hobbit" Authentication realm: <https://hobbitmon.svn.sourceforge.net:443> SourceForge Subversion area Password for 'tjyang': Adding branches/tjyang Adding branches/tjyang/trunk Committed revision 5645. [tjyang@fc6 hobbitmon]$
- creating a subdirectory.
[tjyang@fc6 trunk]$ svn status A pkg M README [tjyang@fc6 trunk]$ mkdir pkg/tww [tjyang@fc6 trunk]$ svn status ? pkg/tww A pkg M README [tjyang@fc6 trunk]$ svn add pkg/tww A pkg/tww [tjyang@fc6 trunk]$ pwd /home/tjyang/hobbitmon/branches/tjyang/trunk [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ pwd /home/tjyang/hobbitmon/branches/tjyang/trunk [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ history |grep commit 1159 svn commit -m "T.J. Yang's copy of hobbit" 1217 history |grep commit 1240 history |grep commit [tjyang@fc6 trunk]$ svn commit -m "add pkg directory" Sending trunk/README Adding trunk/pkg Adding trunk/pkg/tww Transmitting file data . Committed revision 5646. [tjyang@fc6 trunk]$
Development Road Map
editHenrik, Feb 9 2009
editOn February 9, Henrik posted the following roadmap to the list. I haven't heard much lately so I don't know if it has changed.
Version 4.4:
- SNMP support for data collection
- Status updates based on data collected in the RRD files (this is really nice - essentially, *any* value you put into an RRD file can trigger a new or modified status in Xymon. So you could eg. change the status of your "http" test to go red, if the response time of a webpage exceeds 5 seconds).
- Status "flap" handling, to catch statuses that change rapidly.
Version 4.5:
- Support for communication between clients and Xymon to use compression and/or encryption.
- Support for client authentication via SSL certificates (so you cannot spoof a client message).
Version 4.6:
- Revised web interface - eliminate the need for webserver-based authentication, and provide more fine-grained authorization for the various Xymon components.
- Per-user custom login pages, so the login will always show those systems that the user has responsibility for / is allowed to access.
Somewhere along the road I will also introduce a new "ping" test daemon - I am getting to the point where ping'ing all hosts take longer than 5 minutes (I have a lot of hosts). So something needs to be done, and I think I know how to do it.
Changes
editTodos
editTasks that most team member agree to implement.
Design Document
editWish Lists
edit- Test Suite for software quality assurance.
- Migrate all the bb modules from deadcat.net to hobbit.
- SLA Report built in.
- Better Theme support.
- Provide encrypted communication pipe between hobbit server and hobbit client.
- hobbit messages compression.
- ipv6
- 4.2.x maintenance release.
- Rewrite of the alerts module to work properly. ;) It's quite flawed at the moment.
Xymon volunteers Roles and Responsibility
editThis is a list of people offer their time and skill to Xymon community in following areas of R&R.
- Project Admin
- Has right as project admin on sourceforge.
- Assign tickets to different persons listed below.
- Grant new developer privilege on sourceforge.
- Get people to work as a team with limited and un-paid resources.
- Development
- Understand Xymon source tree.
- Do source code documentation.
- Work on ticket from issue tracker.
- Apply patches submitted from the Xymon community.
- Implement new requested features
- Documentation
- Keep troff files updated with Xymon features.
- maintain troff2html process.
- Create a publish-grade manuals and process for Xymon using Latex.
- use latex2troff tool to generate Xymon troff manpage sources.
- Automate the document generation in "make" command process.
- Keep troff files updated with Xymon features.
- End User Support
- Answer questions raised in xymon user email list.
- Maintain Xymon FAQ.
- Test out new Xymon features or verify a bug.
- Module Development
- Write new Xymon client external modules.
- Write Xymon Server side external modules.
- Maintain orphan Xymon modules.
- Maintain Xymon module development guides.
Name | Project Admin | Development | Documentation | End User Support | Module Development |
---|---|---|---|---|---|
Henrik Størner | Yes | ||||
T.J. Yang | Yes | Yes | Yes | ||
Jerald Sheets | Yes | ||||
Josh Luthman | |||||
Malcolm Hunter | Yes | Yes | |||
Japheth J.C. Cleaver | |||||
Steve Holmes | Y | Y | ? | ||
Damien Martins (aka doctor madness) | N | Y | Y | N | |
dubby | Yes | ||||
Flemming | Yes | ||||
Christoph Berg | Yes | Yes | |||
Vadim Pushkin | Yes | ||||
Martin Ward | Yes | ||||
Buchan Milne | Yes | ||||
Rich Smrcina | Yes | ||||
Kenneth Langford | Yes | ||||
Padraig Lennon | |||||
David Baldwin | Yes | ||||
Ralph Mitchell | Yes | Yes | |||
Dummy Template Replace Here | Admin Y/N | Dev Y/N | Doc Y/N | User Support Y/N | Module devel Y/N |
Olivier AUDRY | Yes | Yes | |||
Neil Franken | Yes | Yes | |||
Peter Toft |
Packager Who is who
edit- blingme: Mandriva
- Christoph Berg (Myon): debian
Developers Who is who
edit- Henrik Stoerner: http://www.hswn.dk
- Make Big Brother system monitor to be open again.
- Rewrite Big Brother shell scrip part into C code to speed up the performance.
- Amazon Wish List
- Rich Smrcina
- Buchan Milne
- T.J. Yang
- hobbit wiki book project.
- Autoconfiscate Hobbit.
- Hobbit documentation project.
- Will use latex to create hobbit manual.
- Digitation of hobbit software build,package build and deployment process.
- OpenSolaris VMWare appliance for Hobbit Development.
- Using EXTJS 3.0 for hobbit menu system.
Developers
edit- Vernon Everett
- hobbit wiki and documentation.
- Etienne GRIGNON (etienne.grignon@gmail.com )
- Francesco Duranti <fduranti@q8.it>
- Ability to patch hobbit source code.
- http://www.hswn.dk/hobbiton/2006/10/msg00080.html
- TWW Inc.
- Package the hobbit client and server using TWW toolsets.
List of Names contributed to this hobbit project
editManon Goo <manon@manon.de> Alex Tang <altitude@cic.net> Tim Hudson (tjh@cryptsoft.com) Steve Reid <steve@edmweb.com> Thomas Roessler <roessler@does-not-exist.org> Wei Dai <weidai@eskimo.com> Eric Young (eay@cryptsoft.com) Charles Goyard <cg@fsck.Fr> Marco Avvisano Paul Backer Olivier Beau Adamets Bluejay Brian Buchanan Massimo Carnevali Douwe Dijkstra Francesco Duranti Lars Ebeling Tom Georgoulias Laurent Grilli Kevin Hanrahan Asif Iqbal Charles Jones Thomas J Jones Uwe Kirbach Joshua Krause Patrick Lin Brian Lynch Thomas Mattsson Michael Fisher Daniel J McDonald Werner Michels Christian Perrier Jure Peternel William Richardson Torsten Richter Chris Ricker Tim Rotunda Thomas Rucker Mirko Saam Thomas Schfer Tom Schmidt Eric Schwimmer Bill Simaz Gavin Stone-Tolcher Jeff Stoner David Stuffle Christian Thibodeau Rick Waegner Rob Watson
Autoconfiscate Hobbit
editThis section describe the conversion of hobbit source tree into autotool control.
Why the autoconfiscation ?
edit- To be more portable across OS platforms.
- Plan for I18n and L10n.
- To become true GNU software which require use of autotool.
Learn autotool
edit- the autotools tutorial and read the pdf slides.
- hand on testing on hello world example.
- example of using autoscan.
Convert hobbit source tree
edit- make sure your autotool sets has following version.
GNU Autoconf 2.61 (November 2006) GNU Automake 1.10 (October 2006) GNU Libtool 1.5.24 (June 2007) GNU Gettext 0.17 (November 2007)
- download the latest hobbit source tar ball.
- run autoscan to get configure.scan and then modify it as configure.ac.
- convert lib/Makefile demotool/Makefile ... etc into Makfile.am.
- Fine tune configure.ac to take configuration options as configure options.
- Support Linux and Solaris OS setting in configure.ac.
References
editXymon Documentation
edit- Current
- Henrik Stroner use troff to generate manual pages so that we have the RTFM type of documentation.
- Also troff2html is used to create html page for web browser viewing.
- Enhancements Proposals.
- Use latex+dia+make+wiki to create publishing grade docs
- Use Table of Conetent, index, references and Figures to describe Xymon related topic.
- Generate Xymon User Guide.
- Generate Xymon Developer Guide
- Generate Xymon System Admin Guide.
- Generate Xymon Slide for presentation purpose.
- Use Wiki documentation content incubation.
- Generate html.RTF and pdf for different purpose.
- Request Development Team to use doxygen syntax for source code documentation.
MediaWiki to DocBook
edit- use mvc to gain hobbit wiki source
- convert mediawiki source to latex.
Man pages
editReuse content from existing hobbit documentation source
editXymon test suite
editRun through test cases to verify the code changes are ok.
Performance test scripts
editQuality assurance test scripts
editshell scripts
edit- test script in build directory of hobbit-4.0.3 to make sure depended software are in build machine.
build/perl.sh build/fping.sh build/rrd.sh build/ssl.sh build/ldap.sh build/pcre.sh
Test script by Perl
editTest script by Python
editTest script by DejaGNU
editDtrace probes in hobbit server
editPackaging
editHobbit Client for OpenSolaris IPS format
edit- Features of This hobbit client
- This hobbit client will use a local account and group to avoid NIS and NFS dependency.
- It will use SMF to start/top hobbit client.
- It will use sudo or Solaris 10's ACL to achieve reading restricted information off OpenSolaris.
- hobbit-client-serverconf is simple version of hobbit client without local messages processing.
- hobbit-client-local will do some processing filtering, it need more depended software.
- it use /opt/hobbitclient42 as installation path.
- svcadm disable/enable network:/hobbit-client-serverconf
OpenSolaris info
edit- OpenSolaris 2008.05
-bash-3.2# uname -a SunOS opensolaris 5.11 snv_86 i86pc i386 i86pc -bash-3.2# cat /etc/release Open Solaris 2008.05 snv_86_rc2a X86 Copyright 2008 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 23 April 2008 -bash-3.2#
- Installed Sun and SUNW gcc-3.4.3 compilers.
- if not installed run "pkg install sunstudioexpress" and "pkg install SUNWgcc".
-bash-3.2# pkg info sunstudioexpress SUNWgcc Name: sunstudioexpress Summary: Sun Studio Express - C, C++, & Fortran compilers and Tools State: Installed Authority: opensolaris.org (preferred) Version: 0.2008.5 Build Release: 5.11 Branch: 0.86 Packaging Date: Wed Apr 30 21:10:32 2008 Size: 566.2 MB FMRI: pkg:/sunstudioexpress@0.2008.5,5.11-0.86:20080430T211032Z Name: SUNWgcc Summary: gcc - The GNU C compiler State: Installed Authority: opensolaris.org (preferred) Version: 3.4.3 Build Release: 5.11 Branch: 0.86 Packaging Date: Sat Apr 26 18:22:21 2008 Size: 60.4 MB FMRI: pkg:/SUNWgcc@3.4.3,5.11-0.86:20080426T182221Z -bash-3.2#
Using shell script to automate package building
editRPM
edit[root] cat build/makerpm.sh #!/bin/sh REL=$1 if [ "$REL" = "" ]; then echo "Error - missing release number" exit 1 fi cd ~/hobbit rm -rf rpmbuild # Setup a temp. rpm build directory. mkdir -p rpmbuild/RPMS rpmbuild/RPMS/i386 rpmbuild/BUILD rpmbuild/SPECS rpmbuild/SRPMS rpmbuild/SOURCES cat >rpmbuild/.rpmmacros <<EOF1 # Default macros for my enviroment. %_topdir `pwd`/rpmbuild %_tmppath /tmp EOF1 cat >rpmbuild/.rpmrc <<EOF2 # rpmrc buildarchtranslate: i386: i386 buildarchtranslate: i486: i386 buildarchtranslate: i586: i386 buildarchtranslate: i686: i386 EOF2 cat rpm/hobbit.spec | sed -e "s/@VER@/$REL/g" >rpmbuild/SPECS/hobbit.spec cp rpm/hobbit-init.d rpmbuild/SOURCES/ cp rpm/hobbit.logrotate rpmbuild/SOURCES/ mkdir -p rpmbuild/hobbit-$REL for f in bbdisplay bbnet bbpatches bbproxy build common docs hobbitd include lib scripts do find $f/ | grep -v RCS | cpio -pdvmu ~/hobbit/rpmbuild/hobbit-$REL/ done cp -p Changes configure COPYING CREDITS README ~/hobbit/rpmbuild/hobbit-$REL/ find ~/hobbit/rpmbuild/hobbit-$REL -type d|xargs chmod 755 cd rpmbuild tar zcf SOURCES/hobbit-$REL.tar.gz hobbit-$REL rm -rf hobbit-$REL HOME=`pwd` rpmbuild -ba --clean SPECS/hobbit.spec rpm --addsign RPMS/i?86/hobbit-$REL-*.i?86.rpm mv RPMS/i?86/hobbit-$REL-*.i?86.rpm SRPMS/hobbit-$REL-*.src.rpm ../rpm/pkg/ [root]
Using CPAM tools to automate package building
editHow to participate the hobbit development
edit- subscribe to hobbit mailing list
- create an account on en.wikibooks.org to participate in hobbit documentation effort.
- learn from http://en.wikibooks.org/wiki/CPAM_with_TWW to participate in hobbit automated cross-platform software packaging effort.
Setup your development environment
editOn OpenSolaris x86
editUsing prebuilt OpenSoalris VMWare Image
edit- Download OpenSolaris VMWare Image from here(TBA).
- Install VMWare player 3.0 from here(TBA).
Using VirtualBox OpenSolaris Image
editOn Solaris 10 Intel
edit- host info
bash-3.00# which cvs /opt/csw/bin/cvs bash-3.00# uname -a SunOS unknown 5.10 Generic i86pc i386 i86pc bash-3.00# which gcc /opt/csw/gcc3/bin/gcc bash-3.00# which gmake /opt/csw/bin/gmake bash-3.00#
On RedHat Linux
editSetup your TWW developement
edit- download TWW tools onto your system
- compile hobbit*.[sb|pb].
checkout source code from sourceforge.net
editRead the source codes
editFeedback to Hobbit
edit- include your fix,patch, modules addition to sourceforge.net
Hobbit Functional diagrams
editHobbit server
editSo the core design looks like this: Network tests --\ \ TCP:1984 \ IPC Clients ----------> hobbitd --------> hobbitd_channel ---> worker module / Sh. mem. stdin / Custom tests ---/
Windows Hobbit client
editHobbit Modules Development
editDeveloping Hobbit by Existing Internet Development Environment
editCustom Monitoring Scripts for Hobbit
editSystem Monitoring with Hobbit/HOWTO/Custom Monitoring Scripts for Hobbit http://www.hswn.dk/hobbit/help/hobbit-tips.html#scripts
Developing Hobbit by CPAM/TWW Development Environment
editWhy use CPAM/TWW tool ?
edit- Pros
- Hobbit server and client need to be cross-platform thus the need of CPAM/TWW.
- Like Emacs editor, it can will be run everywhere without license. TWW tools is GPL opensource so it can be ported to any OS.
- A structural and automated approach to deal with packages creation and management.
- Cons
- Another learning curve need to climb.
- Changing people's development habit is hard.
Supported OS
edit- Solaris Sparc
- RH AS 3.0
- HP-UX 11.11
Hobbit package sources
editHobbit client on MS windows Overview
edit- bbwin (Xymon client) is implemented in c++. It requires opensource software like boost c++ libary and tinyXML.
- The packaging tool it used is Microsoft's opensource packaging tool - WiXto do the Win32 packaging.
- The detals building instruction is build.txt on bbwin project site.
- You have two ways to build BBWin.msi,
- Use Microsoft's make: nmake
- Use "Build Soultion" in VS2008.
Following is a procedure to create a Windows XP development box so you can create your own BBWin.msi.
Prepare your Xymon win32 build environment
edit- Install hhc.exe,it is used to compile html doc into windows chm help file.
- add "C:\Program Files\HTML Help Workshop" into PATH so hhc.exe is accessible.
- Install Visual Studio 2008 Standard or Professional Edition.
- Make sure your cmd.exe has following PATH name addition. echo %PATH% %INCLUDE% %LIB% in your DOS prompt.
- PATH
- "LIB=C:\Program Files\Microsoft Platform SDK\Lib\.;C:\Program Files\Microsoft Visual Studio 8\VC\LIB;"
- INCLUDE
INCLUDE=C:\Program Files\Microsoft Platform SDK\Include\.; C:\Program Files\Microsoft Platform SDK\Include\atl;C:\Program Files\Microsoft Visual Studio 8\VC\include
- Install a svn client for your windows machine.
- Windows Server 2003 SP1 Platform SDK Web Install: It is use to have the complete sdk to develop programs on Microsoft OS. Remeber to install all options (include 64 bit and 32 bit) to avoid "atlthunk.lib not found" issue.
- WiX opensource packaging tool from Microsoft: this is use to turn the compiled binary into MS MSI package format.
- Boost C++ library:These powerful C++ libraries are used for some agents and will be certainly used in the BBWin core service in the future.
- Download the pre-compiled 1.35 one for VS2008 and install it under C:\boost directory.
- TinyXML: BBWin used the excellent TinyXML library for the configuration loading XML. You do not need to download and install it. TinyXML sources are included in BBWin sources.
- Prepare your source code editors:
- checkout bbwin src.
- Using command "svn co https://bbwin.svn.sourceforge.net/svnroot/bbwin bbwin"
- Change the Makefile code for C:\boost installation.
- Modify Makefile to point INCLUDE to C:\boost and LIB to include C:\boost\lib\*.lib
- Modify C/C++ iclude c:\boost and Linker to include c:\boost\lib\*.
- Optional software installation
- install cygwin to have a strong unix enviroment on your windows box. So you can run command like following to clean up *.obj file that current makefile can't do.
- Clean up Release directory by Deleting Setup/*.msi
$ rm Setup/* $ rm Release/*
Build the bbwin using command line approach
editBBWin.msi creation process is automated in "C:\BBWin\trunk\Setup\Makefile". This makefile will be called from "C:\BBWin\trunk\Makefile"
- Make sure your nmake command is available.
C:\bbwin-src\trunk>nmake -help Microsoft (R) Program Maintenance Utility Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. Usage: NMAKE @commandfile NMAKE [options] [/f makefile] [/x stderrfile] [macrodefs] [targets] Options: /A Build all evaluated targets /B Build if time stamps are equal /C Suppress output messages /D Display build information /E Override env-var macros /ERRORREPORT:{NONE|PROMPT|QUEUE|SEND} Report errors to Microsoft /G Display !include filenames /HELP Display brief usage message /I Ignore exit codes from commands /K Build unrelated targets on error /N Display commands but do not execute /NOLOGO Suppress copyright message /P Display NMAKE information /Q Check time stamps but do not build /R Ignore predefined rules/macros /S Suppress executed-commands display /T Change time stamps but do not build /U Dump inline files /Y Disable batch-mode /? Display brief usage message C:\bbwin-src\trunk>
- cd to c:\bbwin top source directory.
- type "nmake" to kick off the build.
Compilation error
editatlbase.h not found
edit- Error message
C:\bbwin\trunk\Core\Agents\common>nmake Microsoft (R) Program Maintenance Utility Version 9.00.30729.01 Copyright (C) Microsoft Corporation. All rights reserved. cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X 86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -DNTDDI_VERSION=0x050 00000 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I C:\boost\include\boos t-1_33_1 -D_MT -MTd SystemCounters.cpp SystemCounters.cpp SystemCounters.cpp(20) : fatal error C1083: Cannot open include file: 'atlbase.h ': No such file or directory NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 9.0\VC\BIN \cl.EXE"' : return code '0x2' Stop. C:\bbwin\trunk\Core\Agents\common>
- make sure you have following directory and file, if not then you need to use VS non-Express version.
C:\Program Files\Microsoft Visual Studio 8\VC\atlmfc\include\atlbase.h
Temporary Fix for following
edit- Goal is to get rid of " -D_MT -MTd" when using cl MS compiler.
- Run this command in cygwin shell on your codebase, "find . -type f -name Makefile -exec perl -pi -e 's!cvarsmt!conlibsdll!' {} \;" , to replace cvarsmt with conlibsdll. I don't know the exact impact of not building code with multihreading library.
* LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
edit*** C:\bbwin09\trunk\Core\Agents\procs *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L link /DLL procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib Microsoft (R) Incremental Linker Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj) Creating library procs.lib and object procs.exp LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library procs.dll : fatal error LNK1169: one or more multiply defined symbols found NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x491' Stop. *** C:\bbwin09\trunk\Core\Agents\sample *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L *** C:\bbwin09\trunk\Core\Agents\bbwinupdate *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L C:\bbwin09\trunk\Core>
- http://msdn.microsoft.com/en-us/library/Aa267384
- Possible fix with similar issue.
- vc6 to vc8.
- Try to link with "/NODEFAULTLIB:library".
C:\bbwin09\trunk\Core\Agents\procs>nmake clean nmake clean Microsoft (R) Program Maintenance Utility Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. erase /Q /S procs.res procs.obj procs.dll procs.exp procs.lib procs.obj Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.res Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.obj Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.exp Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.lib C:\bbwin09\trunk\Core\Agents\procs>nmake nmake Microsoft (R) Program Maintenance Utility Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I ../common /I C:\boost\include\boost-1_33_1 -D_MT -MTd procs.cpp procs.cpp C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(68) : warning C4996: 'localtime': This function or variable may be unsafe. Consider using localtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(114) : see declaration of 'localtime' C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(75) : warning C4996: 'gmtime': This function or variable may be unsafe. Consider using gmtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(101) : see declaration of 'gmtime' C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/type_traits/is_base_and_derived.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(252) : warning C4996: 'std::char_traits<char>::copy': Function call with parameters that may be unsafe - this call relies on the caller to check that the passed values are correct. To disable this warning, use -D_SCL_SECURE_NO_WARNINGS. See documentation on how to use Visual C++ 'Checked Iterators' C:\Program Files\Microsoft Visual Studio 8\VC\include\iosfwd(446) : see declaration of 'std::char_traits<char>::copy' C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(223) : while compiling class template member function 'int boost::io::basic_altstringbuf<Ch,Tr,Alloc>::overflow(int)' with [ Ch=char, Tr=std::char_traits<char>, Alloc=std::allocator<char> ] C:\boost\include\boost-1_33_1\boost/format/format_class.hpp(136) : see reference to class template instantiation 'boost::io::basic_altstringbuf<Ch,Tr,Alloc>' being compiled with [ Ch=char, Tr=std::char_traits<char>, Alloc=std::allocator<char> ] procs.cpp(235) : see reference to class template instantiation 'boost::basic_format<Ch>' being compiled with [ Ch=char ] Rc /r -DWIN32 -D_WIN32 -DWINVER=0x0500 -DDEBUG -D_DEBUG /fo procs.res procs.rc link /NODEFAULTLIB:library procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib Microsoft (R) Incremental Linker Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj) Creating library procs.lib and object procs.exp LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library LIBCMTD.lib(crt0.obj) : error LNK2019: unresolved external symbol _main referenced in function ___tmainCRTStartup procs.dll : fatal error LNK1120: 1 unresolved externals NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x460' Stop. C:\bbwin09\trunk\Core\Agents\procs>
build the bbwin using GUI approach
edit- check out the source code
- open up bbwin.sln
follow text will turn into wiki procedure above. Build file for BBWin 2 ============================================================== 3 4 This file explains you how to build BBWin from the sources. 5 6 7 Getting the last sources 8 ======================== 9 10 BBWin is developped in C++ (the Standard Template Library and the Standard C++ Library 11 are used) 12 The source of BBWin are available from the sourceforge subversion 13 repository for the BBWin projects : 14 http://svn.sourceforge.net/viewcvs.cgi/bbwin/ 15 16 17 Install the tools 18 ================= 19 20 BBWin has been developped thanks to many tools. You should install them to 21 build BBWin easily without troubles. 22 23 Windows Platform SDK 2003 : it is used for the development environment. 24 It is use to have the complete sdk to develop programs on Microsoft OS. 25 You can download it for free from microsoft website : 26 http://www.microsoft.com/downloads/details.aspx?FamilyId=A55B6B43-E24F-4EA3-A93E-40C0EC4F68E5&displaylang=en 27 You will need 1 gb of free space if you install every thing :) 28 BBWin Makefiles are using the nmake tool and Makefile templates from the SDK. 29 This SDK is very important for anyone who would like to start developing under Windows. 30 31 Visual C++ Toolkit : it is the compiler used to build the bbwin release 32 It is the original compiler from Visual Studio 2003 Professional (Code optimisation is included) 33 You can download it for free from the Microsoft website : 34 http://msdn.microsoft.com/visualc/vctoolkit2003/ 35 36 Wix Toolkit : this package is used to build the BBWin MSI installer 37 You should install it and have the bin directory in your current path 38 http://sourceforge.net/projects/wix/ 39 40 TinyXML : BBWin used the excellent TinyXML library for the configuration loading XML. 41 You do not need to install it. TinyXML sources are included in BBWin sources. 42 43 Boost Lib : These powerful C++ libraries are used for some agents and will be 44 certainly used in the BBWin core service in the future. 45 You should get the boost C++ from the website : 46 http://www.boost.org/ 47 Build it in the directory C:\boost so you won't have to change BBWin Makefiles. 48 If you want to build BBWin with Visual C++ Express 2005, please read the following page : 49 http://www.boost.org/tools/build/v1/vc-8_0-tools.html 50 51 52 I recommand you the Notepad++ editor if you are looking for a nice free code editor. 53 You can download it from : 54 http://notepad-plus.sourceforge.net 55 56 57 58 Building the BBWin with Visual C++ Express 2005 59 =============================================== 60 61 Open the BBWin.sln file at the top directory of the project 62 First, you should prepare your Visual C++ configuration by adding 63 in the default bin, include and lib directories the different directories from : 64 65 - the platform SDK 66 - the boost libraries 67 68 Then just build the solution. 69 70 71 Building the BBWin with Visual C++ ToolKit 2003 72 =============================================== 73 74 Open a Platform SDK Build command line environment (installed with the Platform SDK) 75 Go the top directory of the BBWin source tree 76 Type nmake 77 Go get a cup of coffee 78 It's ready ! 79 80 If you get errors, it may be due to some errors in your include or lib path. 81 Make sure the environment variables %Lib%; %Path% and %Include% are correctly 82 configured. You may need to add some directories. 83 84 Building process order 85 ====================== 86 87 1) BBWin core service 88 2) Agents 89 3) Externals (needing compilation) 90 4) Setup MSI 91
- Example of using nmake to create a BBwin.msi
C:\tmp\test\trunk\Setup>nmake clean Microsoft (R) Program Maintenance Utility Version 8.00.50727.42 Copyright (C) Microsoft Corporation. All rights reserved. erase /q /s BBWin.dll BBWin.exp UpgradeConfiguration.obj BBWin.res BBWin .wixobj BBWin.msi BBWin.lib Deleted file - C:\tmp\test\trunk\Setup\BBWin.wixobj Deleted file - C:\tmp\test\trunk\Setup\BBWin.msi C:\tmp\test\trunk\Setup>nmake Microsoft (R) Program Maintenance Utility Version 8.00.50727.42 Copyright (C) Microsoft Corporation. All rights reserved. candle /nologo BBWin.wxs BBWin.wxs light /nologo BBWin.wixobj C:\tmp\test\trunk\Setup>
bbwin 0.9 package source
editHobbit server software build source
editHow to use hobbit-4.0.3.sb build source ?
edit- hobbit-4.0.3.sb is an XML file contain the detail exact steps to build hobbit-4.03. into binary code for different OS. It need to be run against "sb" tool.
- TBA.
The source : hobbit-4.0.3.sb
edit[root] cat hobbit-4.0.3.sb <?xml version="1.0"?> <programs> <program name="hobbit" version="4.0.3" revision="1"> <module name="default"> <build-name>hobbit-4.0.3</build-name> <install-name>hobbit</install-name> <syntaxhighlights> <syntaxhighlight path="src/hobbit-4.0.3.tar.gz" /> </sources> <dependencies> <depend var="fping">fping24</depend> <depend var="APACHESS">apacheS2048</depend> <depend var="RRDTOOL">rrdtool10</depend> <depend var="PCRE">libpcre44</depend> <depend var="OPENSSL">libopenssl097</depend> <depend var="OPENLDAP">openldap2127</depend> </dependencies> <!-- ###################################### # Platform specific configuration ###################################### --> <configure> <![CDATA[ case "${SB_SYSTYPE}" in *-hpux11.11) ;; *-hpux10.20) ;; *-linux*) ;; *-solaris2*) ;; esac set -x rm -f Makefile TARGET=hobbit \ ENABLESSL=y \ ENABLELDAP=y \ ENABLELDAPSSL=y \ BBUSER=hobbit \ BBTOPDIR=/opt/TWWfsw/hobbit \ BBVAR=/var/opt/TWWfsw/hobbit/data \ BBHOSTURL=/hobbit \ CGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-bin \ BBCGIURL=/hobbit-cgi \ SECURECGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-secure \ SECUREBBCGIURL=/hobbit-seccgi \ HTTPDGID=il02w-web \ BBLOGDIR=/var/opt/TWWfsw/hobbit/log/hobbit \ BBHOSTNAME=localhost \ BBHOSTIP=127.0.0.1 \ MANROOT=/opt/TWWfsw/hobbit/man \ BARS=all \ USENEWHIST=y \ PIXELCOUNT=960 \ MAKE=/opt/TWWfsw/bin/gmake \ INSTALLBINDIR=/opt/TWWfsw/hobbit/server/bin \ INSTALLETCDIR=/opt/TWWfsw/hobbit/server/etc \ INSTALLWEBDIR=/opt/TWWfsw/hobbit/web \ INSTALLEXTDIR=/opt/TWWfsw/hobbit/server \ INSTALLTMPDIR=/var/opt/TWWfsw/hobbit/tmp \ INSTALLWWWDIR=/opt/TWWfsw/hobbit/server/www ./configure \ --rrdinclude /opt/TWWfsw/rrdtool10/include \ --rrdlib /opt/TWWfsw/rrdtool10/lib \ --pcreinclude /opt/TWWfsw/libpcre44/include \ --pcrelib /opt/TWWfsw/libpcre44/lib \ --sslinclude /opt/TWWfsw/libopenssl097/include \ --ssllib /opt/TWWfsw/libopenssl097/lib \ --ldapinclude /opt/TWWfsw/openldap2127/include \ --ldaplib /opt/TWWfsw/openldap2127/lib \ --fping /opt/TWWfsw/fping24/sbin/fping ]]> </configure> <!-- ###################################### # Now build (compile) the software ###################################### --> <build> <![CDATA[ case "${SB_SYSTYPE}" in *-hpux11.11) gmake ;; *-hpux10.20) ;; *-linux*) gmake ;; *-solaris2.[689]) gmake ;; esac ]]> </build> <install> <![CDATA[ ######################################################## # building hobbit on different OS ######################################################## case "${SB_SYSTYPE}" in *-hpux11.11) gmake install ;; *-hpux10.20) ;; *-linux*) gmake install ;; *-solaris2.[689]) LD_LIBRARY_PATH=/opt/TWWfsw/libopenssl097/lib export LD_LIBRARY_PATH gmake install ;; esac ## create man directory for TWW #ln -s /opt/TWWfsw/hobbit/server/bin /opt/TWWfsw/hobbit/bin #mkdir -p /opt/TWWfsw/hobbit/man #cp -rp /opt/TWWfsw/hobbit/server/www/help/manpages/* /opt/TWWfsw/hobbit/man # ]]> </install> <uninstall> <![CDATA[ set -x rm -rf /opt/TWWfsw/hobbit rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-secure rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/bb-* rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/hobbit* rm -rf /var/opt/TWWfsw/hobbit ]]> </uninstall> </module> <notes> <note type="installation"> <para> This sb file is to digitalize the hobbit software build process for different OS. Original: 05/26/2005 T.J.Yang tj_yang at hotmail do com </para> </note> </notes> <changelog> </changelog> </program> </programs> [root]
Hobbit server package build source
edithobbit-4.0.3.pb
edit[root] cat hobbit-4.0.3.pb <?xml version="1.0"?> <packages> <package name="hobbit" version="4.0.3" revision="1"> <package-manager name="depot"> <title>hobbit</title> <vendor>GPL</vendor> <description > </description> <install-name>hobbit</install-name> <pkgname-base>TWWhobbit</pkgname-base> <version>4.0.3</version> <revision>1</revision> <subpkg type="runtime"> </subpkg> </package-manager> <package-manager name="rpm4"> <category>System Environment/Daemons</category> <title>Hobbit System Monitoring Tool</title> <vendor>GNU</vendor> <description> Hobbit System Monitoring tool. An open-source version of Big Brother. </description> <install-name>hobbit</install-name> <pkgname-base>TWWhobbit</pkgname-base> <init name="/etc/init.d/TWWhobbit" path="pkg/hobbit-init-linux" /> <init link-src="/etc/rc2.d/S661hobbit" link-dest="/etc/init.d/TWWhobbit"/> <init link-src="/etc/rc1.d/K269hobbit" link-dest="/etc/init.d/TWWhobbit"/> <config>/etc/init.d/TWWhobbit</config> <version>4.0.3</version> <revision>1</revision> <subpkg type="runtime"> <depend pkgname-base="TWWperl561" title="perl 5.6.1" subpkg="runtime">v>=5.6.1 r>=1</depend> <depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="runtime">v>=1.0.42</depend> <depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="man">v>=1.0.42</depend> </subpkg> <subpkg type="conf"> <depend pkgname-base="TWWhobbit" title="Client: Big Brother System Monitoring Tool" subpkg="runtime">v>=4.0.3</depend> <postinstall path="pkg/postinstall-linux" /> <preremove path="pkg/preremove-linux" /> <postremove path="pkg/postremove-linux" /> </subpkg> </package-manager> </package> </packages> [root]
Hobbit Required Packages
edit- fping
- apache web server
- rrdtool
- pcre
- openssl
- openldap
- following is the listing of exact version to build hobbit-4.0.3
<dependencies> <depend var="fping">fping24</depend> <depend var="APACHESS">apacheS2048</depend> <depend var="RRDTOOL">rrdtool10</depend> <depend var="PCRE">libpcre44</depend> <depend var="OPENSSL">libopenssl097</depend> <depend var="OPENLDAP">openldap2127</depend> </dependencies>
Following diagram list out all the hobbit depended software by GraphViz
editTBA.
Package build automation
editThe Makefile to automate the whole process
editCreate a firefox search engine plugin for hobbit server
edit- References: http://mycroft.mozdev.org/deepdocs/deepdocs.html
Using relational DBs with Xymon Server
editThe default database back end of Xymon is RRD(Roun-Robin Database).
Database
editRRD
editSQLite3
edit- Almost as fast as C fopen function code.
- No server process, data are store in plain files.
- Just like another rrd file that can be rsynced over to your standby xymon server.
MySql
edit- light weight DB.
Oracle
editLDAP
editXML flat file
editBenefits of using relation DBs
editInventory Monitoring
edit- Store a machine's asset information
- Serial Number
- OS type
- Computer Maker
- Leased/owned
- Trigger an alert if leasing is expiring soon.
- Display pie chart of OS type,Makers ... etc.
bb-hosts generation
edit- bb-hosts files got generated from host database table.
MVC Implementation
editMysql + PHP + EXTJS
editCatalyst/SQLite
editBill of Materials
edit- Catalyst Book 1
- perl-5.10.0
- Fedora 11
- Address Book Example in Book 1.
- SQLite3
- Catalyst::Runtime,Catalyst::Plugins::*,Catalyst::Devel.
- Sql files to create Asset schema.
Procedures
edit- Use catalyst.pl to initiate your MVC project with sample templates.
[tjyang@t-fedora11 test]$ catalyst.pl xymonasset created "xymonasset" created "xymonasset/script" created "xymonasset/lib" created "xymonasset/root" created "xymonasset/root/static" created "xymonasset/root/static/images" created "xymonasset/t" created "xymonasset/lib/xymonasset" created "xymonasset/lib/xymonasset/Model" created "xymonasset/lib/xymonasset/View" created "xymonasset/lib/xymonasset/Controller" created "xymonasset/xymonasset.conf" created "xymonasset/lib/xymonasset.pm" created "xymonasset/lib/xymonasset/Controller/Root.pm" created "xymonasset/README" created "xymonasset/Changes" created "xymonasset/t/01app.t" created "xymonasset/t/02pod.t" created "xymonasset/t/03podcoverage.t" created "xymonasset/root/static/images/catalyst_logo.png" created "xymonasset/root/static/images/btn_120x50_built.png" created "xymonasset/root/static/images/btn_120x50_built_shadow.png" created "xymonasset/root/static/images/btn_120x50_powered.png" created "xymonasset/root/static/images/btn_120x50_powered_shadow.png" created "xymonasset/root/static/images/btn_88x31_built.png" created "xymonasset/root/static/images/btn_88x31_built_shadow.png" created "xymonasset/root/static/images/btn_88x31_powered.png" created "xymonasset/root/static/images/btn_88x31_powered_shadow.png" created "xymonasset/root/favicon.ico" created "xymonasset/Makefile.PL" created "xymonasset/script/xymonasset_cgi.pl" created "xymonasset/script/xymonasset_fastcgi.pl" created "xymonasset/script/xymonasset_server.pl" created "xymonasset/script/xymonasset_test.pl" created "xymonasset/script/xymonasset_create.pl" [tjyang@t-fedora11 test]$ catalyst.pl
- perl Makefile.PL
[tjyang@t-fedora11 xymonasset]$ perl Makefile.PL include /var/www/html/test/xymonasset/inc/Module/Install.pm include inc/Module/Install/Metadata.pm include inc/Module/Install/Base.pm Cannot determine perl version info from lib/xymonasset.pm include inc/Module/Install/Catalyst.pm *** Module::Install::Catalyst include inc/Module/Install/Makefile.pm Please run "make catalyst_par" to create the PAR package! *** Module::Install::Catalyst finished. include inc/Module/Install/Scripts.pm include inc/Module/Install/AutoInstall.pm include inc/Module/Install/Include.pm include inc/Module/AutoInstall.pm *** Module::AutoInstall version 1.03 *** Checking for Perl dependencies... [Core Features] - Catalyst::Runtime ...loaded. (5.71001 >= 5.71001) - Catalyst::Plugin::ConfigLoader ...loaded. (0.22) - Catalyst::Plugin::Static::Simple ...loaded. (0.20) - Catalyst::Action::RenderView ...loaded. (0.09) - parent ...loaded. (0.221) - Config::General ...loaded. (2.42) *** Module::AutoInstall configuration finished. include inc/Module/Install/WriteAll.pm include inc/Module/Install/Win32.pm include inc/Module/Install/Can.pm include inc/Module/Install/Fetch.pm Writing Makefile for xymonasset Writing META.yml [tjyang@t-fedora11 xymonasset]$
Upgrade Xymon Web GUI
editCurrent Xymon(Hobbit) is coded in C and using CGI and html code to compose a simple web interface. Recently, we have a few javascript framework choices to upgrade xymon server with RIA web interface.
Using qwikioffice for Xymon Dashboard
editUsing Tomatocart's admin tool for Xymon administration tool
editReplace Xymon C/CGI with C/EXTJS
editCompilation Errors and Warning
editPossible Solutions
edit- To remove "unsigned char" usage hobbit src tree.
find . -type f -name "*.[c|h]" -exec perl -pi -e 's!unsigned\schar!char!g' {} \;
- To cast the char that need to be unsigned.
GCC Compilation Warnings
edit- pointer targets in assignment differ in signedness
- "/usr/include/sys/socket.h:214: note: expected socklen_t * __restrict__ but argument is of type int *"
Compilation Warning on 4.3.0 C source code example listing
edit[tjyang@f12 4.3.0]$ gmake MAKE="gmake" CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" `pwd`/build/genconfig.sh Checking for socklen_t Checking for snprintf Checking for vsnprintf Checking for rpc/rpcent.h Checking for sys/select.h Checking for u_int32_t typedef Checking for PATH_MAX definition Checking for SHUT_RD/WR/RDWR definitions Checking for strtoll() config.h created <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o digest.o digest.c digest.c: In function âmd5hashâ: digest.c:40: warning: pointer targets in passing argument 2 of âmyMD5_Updateâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/md5.h:18: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o encoding.o encoding.c encoding.c: In function âbase64encodeâ: encoding.c:31: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:34: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:50: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:60: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:75: warning: pointer targets in return differ in signedness encoding.c: In function âbase64decodeâ: encoding.c:86: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:114: warning: pointer targets in return differ in signedness encoding.c: In function âgetescapestringâ: encoding.c:125: warning: pointer targets in assignment differ in signedness encoding.c: In function ânlencodeâ: encoding.c:181: warning: pointer targets in assignment differ in signedness encoding.c:183: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:187: warning: pointer targets in assignment differ in signedness encoding.c:191: warning: pointer targets in assignment differ in signedness encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness /usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness /usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness /usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c: In function ânldecodeâ: encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness /usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness /usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness /usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â <snip> loadhosts.c: In function âbbh_find_itemâ: loadhosts.c:228: warning: return discards qualifiers from pointer target type loadhosts.c: In function âbbh_itemâ: loadhosts.c:540: warning: pointer targets in passing argument 1 of ânlencodeâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/encoding.h:17: note: expected âunsigned char *â but argument is of type âchar *â loadhosts.c:540: warning: pointer targets in passing argument 2 of âaddtobufferâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/strfunc.h:16: note: expected âchar *â but argument is of type âunsigned char *â loadhosts.c: In function âbbh_item_idâ: loadhosts.c:619: warning: return discards qualifiers from pointer target type <snip> msort.c: In function âmsortâ: msort.c:119: warning: passing argument 4 of âqsortâ from incompatible pointer type /usr/include/stdlib.h:756: note: expected â__compar_fn_tâ but argument is of type âint (*)(void **, void **)â <snip> sha2.c: In function âmySHA224_Finalâ: sha2.c:972: warning: pointer targets in passing argument 2 of âsha224_finalâ differ in signedness sha2.c:812: note: expected âunsigned char *â but argument is of type âchar *â sha2.c: In function âmySHA256_Finalâ: sha2.c:977: warning: pointer targets in passing argument 2 of âsha256_finalâ differ in signedness sha2.c:417: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o sig.o sig.c <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -DCLIENTONLY -c -o timefunc-client.o timefunc.c ar cr hobbitclient.a osdefs.o cgiurls.o color-client.o digest.o encoding.o environ-client.o errormsg.o holidays.o ipaccess.o loadhosts.o md5.o memory.o misc.o msort.o rbtr.o rmd160c.o sendmsg.o sha1.o sha2.o sig.o stackio.o strfunc.o suid.o timefunc-client.o ranlib hobbitclient.a || echo "" gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/lib' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLFLAGS="" SSLINCDIR="" SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C common client gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/common' <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -c -o bbdigest.o bbdigest.c bbdigest.c: In function âmainâ: bbdigest.c:48: warning: pointer targets in passing argument 2 of âdigest_dataâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/digest.h:26: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -o ../client/bbdigest bbdigest.o ../lib/hobbitclient.a -lrt gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/common' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C build all gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/build' gcc -o merge-lines -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-lines.c gcc -o merge-sects -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-sects.c gcc -o setup-newfiles -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -Wl,--rpath, setup-newfiles.c ../lib/hobbitclient.a -lrt setup-newfiles.c: In function âmainâ: setup-newfiles.c:27: warning: pointer targets in assignment differ in signedness setup-newfiles.c:79: warning: pointer targets in passing argument 1 of âstrstrâ differ in signedness /usr/include/string.h:340: note: expected âconst char *â but argument is of type âunsigned char *â gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/build' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" BBHOME="/home/xymon/client" BBHOSTIP="127.0.0.1" LOCALCLIENT="no" NETLIBS="" LIBRTDEF="-lrt" gmake -C client all gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/client' <snip> msgcache.c: In function âmainâ: msgcache.c:537: warning: pointer targets in passing argument 3 of âacceptâ differ in signedness /usr/include/sys/socket.h:214: note: expected âsocklen_t * __restrict__â but argument is of type âint *â cat hobbitclient.cfg.DIST | sed -e 's!@BBHOSTIP@!127.0.0.1!g' >hobbitclient.cfg ../build/bb-commands.sh >>hobbitclient.cfg cat clientlaunch.cfg.DIST | sed -e 's!@CLIENTFLAGS@!!g' >clientlaunch.cfg gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/client' Build complete. Now run 'gmake install' as root [tjyang@f12 4.3.0]$
Xymon GUI ideas
editGUI Requirements
edit- Keep cgi+html+tigramenu for legacy support.
- Include modern Javascript GUI framework like extjs or jQuery.
- Provide realtime web GUI update from clients using AJAX.
- Waiting for 1+ minutes to see the changes from web page is barely acceptable but hope to avoid.
From Neil Franken
edit- Use CSS to provide easy theme and resolution change.
- Resolutions:
- Themes:
- Enable fine-grained control on columns in different views.
From T.J. Yang
editI found following combination of existing opensource software can make up a new GUI for Xymon. End user can still see old cgi+html GUI.
- Use extjs for new GUI and miframe.js to contain old tigra menu GUI in a frame.
- See Xymon Desktop Prototype.
Using command line tool to update this wiki book
editInstallation of mediawiki client in perl
edit- Mediawik command line tool
- A makefile script to automate the hobbit documentation effort.