Fedora 15: a NFSv4 to glusterfs migration HOW-TO
by Dr. Michael J. Chudobiak
As detailed in another thread, we upgraded a few test machines on our
LAN to Fedora 15 (with gnome-shell and firefox), with user folders
served from a NFSv4 server (F14 originally, then F15).
It just didn't work. The F15 desktops would freeze frequently. And
worse, this would freeze ALL desktops on the LAN intermittently, as the
NFS server struggled with client flakiness.
When it did work, Firefox would lose authenticated logins randomly,
presumably due to corruption of its cookies.sqlite file. sqlite and NFS
seems to be a nightmare, for both NFSv3 and NFSv4.
Moving from a NFSv4 server to a glusterfs server solved all of these
problems, and sped up boot times significantly too. glusterfs looks
intimidating at first, because of all its fancy replicating features and
what-not, but it turns out to be trivially easy to set up a simple
server than will replace 95% of the NFS installations out there.
Luckily, you can easily point both the NFS daemon and the glusterfs
daemon at the same export folder, so you can migrate clients slowly over
time.
This HOW-TO is intended to document the process. There are other similar
HOW-TOs out there, but they are all a little out-of-date or don't show
how to enable locking correctly, which is critical for Firefox.
In this example, we export the server's /fileserver folder, and mount it
on /fileserver on the clients. In my server, /fileserver was already
being served by the NFSv4 server, which is fine.
--------------------------------------------
1. On the server:
- yum install glusterfs-server
--------------------------------------------
2. On each client:
- yum install glusterfs-fuse
- mkdir /etc/glusterfs/
- mkdir /fileserver
--------------------------------------------
3. On the server, edit the volume configuration file
(/etc/glusterfs/glusterfsd.vol) so that it looks like this:
volume raw
type storage/posix
option directory /fileserver
end-volume
volume brick
type features/posix-locks
subvolumes raw
end-volume
volume server
type protocol/server
option transport-type tcp
subvolumes brick
option auth.addr.brick.allow *
end-volume
The first stanza selects the basic folder to export.
The second stanza adds file locking to it. This is required to support
Firefox, and some other applications.
The third stanza authorizes everyone to access this file-locked export
over the network.
There is also a /etc/glusterfs/glusterfsd.vol file on the system, for
configuring the management interface. For this simple installation it
does not need to be modified.
--------------------------------------------
4. Restart the server services:
- service glusterd restart
- service glusterfsd restart
I believe the first service is a management service, and the second is
the actual file-export service.
--------------------------------------------
--------------------------------------------
5. On the client, create the /etc/glusterfs/glusterfs.vol configuration
file, which should look like this:
volume client
type protocol/client
option transport-type tcp
option remote-host 192.168.0.3 # use YOUR server IP here
option remote-subvolume brick
end-volume
--------------------------------------------
6. On the client, add this line to the end of /etc/rc.d/rc.local:
mount -t glusterfs /etc/glusterfs/glusterfs.vol /fileserver
--------------------------------------------
7. On the client, reboot, and check /var/log/messages for errors. On one
machine, we had an selinux problem that was flagged in the logs. We had
to manually create the logging file using:
touch /var/log/glusterfs/fileserver.log; reboot
--------------------------------------------
8. On the client, see if you can access the files in /fileserver. If
not, read the /var/log/glusterfs/* files on both the client and the server.
At this point, everything should work!
Weird things and gotchas:
A. You need the file-locking option to make Firefox work properly.
B. LibreOffice wouldn't start on one system, until we did:
rm ~/.libreoffice
rm ~/.openoffice.org
C. selinux prevented the creation of log files on one client, which
prevented the filesystem from mouting. The manual fix noted above fixed
that.
D. This HOWTO mounts the glusterfs from /etc/rc.d/rc.local, which is the
last step in the boot process. In theory, you can mount it from
/etc/fstab or using autofs. However, we found that autofs mounting just
didn't work - not sure why. fstab mounting didn't work either - I
suspect it occurred too early in the boot process. /etc needs to be up
and running so glusterfs can read the config file, and I don't think the
current init/systemd files handle this correctly. There are some Debian
bug reports about this that you can google.
I hope this is useful to someone, and that we can finally drive a stake
through the heart of NFS...
- Mike
12 years, 7 months
Cannot boot properly: dbus problems?
by Nick Urbanik
Dear Folks,
After a power surge and a spontaneous reboot, my 4-core F15 x86_64 machine
has been unhappy. I have forced a selinux relabel, and a forcefsck.
Symptoms:
1. The graphical boot did not complete: it started Nagios, but cupsd
failed to start, and gdm did not start up.
2. I cannot log in on the text consoles; I can type the username, but
no prompt appears for the password.
3. Attempts to use sudo just hang.
4. I can log in by ssh as either myself or as root.
5. named is using "97.5%" CPU, though when I turn on querylogging,
there are very few lookups.
6. Attempts to start cups result in complaints about dbus:
# systemctl start cups.service
Failed to get D-Bus connection: Failed to authenticate in time.
/var/log/messages says nothing of the matter.
Now systemctl is new to me, and I am not sure how to diagnose this.
I would be grateful for any suggestions. Where should I look for
further clues?
--
Nick Urbanik http://nicku.org 808-71011 nick.urbanik(a)optusnet.com.au
GPG: 7FFA CDC7 5A77 0558 DC7A 790A 16DF EC5B BB9D 2C24 ID: BB9D2C24
I disclaim, therefore I am.
12 years, 7 months
Frostwire execution problem
by Mickey
F15
I installed frostwire and executed same and got error, can someone tell
what this error message means.
$ frostwire
HOSTNAME IS BigOne
Starting FrostWire...
Java exec found in PATH. Verifying...
Suitable java version found [java = 1.6.0_27]
Configuring environment...
Loading FrostWire:
ls: cannot access lw*jar: No such file or directory
ls: cannot access *jar: No such file or directory
CLASSPATH SET TO: .
Exception in thread "main" java.lang.NoClassDefFoundError:
com/limegroup/gnutella/gui/Main
Caused by: java.lang.ClassNotFoundException: com.limegroup.gnutella.gui.Main
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
Could not find the main class: com.limegroup.gnutella.gui.Main. Program
will exit.
******************************************************************
Something went wrong with FrostWire.
Maybe you're using the wrong version of Java?
(FrostWire is tested against and works best with with Sun's JRE, Java 1.4+)
The version of Java in your PATH is:
java version "1.6.0_27"
Java(TM) SE Runtime Environment (build 1.6.0_27-b07)
Java HotSpot(TM) Server VM (build 20.2-b06, mixed mode)
12 years, 7 months
selinux is a pain
by Martín Marqués
I reinstalled (better hardware) a server and had selinux enabled (was
disabled before), and I starting to see why so many people don't use
selinux.
My question is, how many people are using selinux?
I, for instance, am about to disable it.
--
Martín Marqués
select 'martin.marques' || '@' || 'gmail.com'
DBA, Programador, Administrador
12 years, 7 months
More liive linuux distributions available
by Aaron Konstam
I don't know when this happened but unetbootin-linux-555 is now
available. This allows dozens of live Linux distributions to be
downloaded onto a USB stick. The new version includes Fedora 15. The yum
available unetbootin does not allow this.
You can download it from:
http://www.unetbootin.sourceforge.net
This allowed me to download the latest Ubuntu version. I admit the
interface as at leas as weird as Gnome 3.
--
=======================================================================
Never leave anything to chance; make sure all your crimes are
premeditated.
=======================================================================
Aaron Konstam telephone: (210) 656-0355 e-mail: akonstam(a)sbcglobal.net
12 years, 7 months
Re: F14, google-chrome won't launch after yum update
by Jackson Byers
Daniel J Walsh replied
>This is definitely something in SELinux. The current upstream google
>chrome is a little strange from an SELinux point of view. Have you
>tried chromium?
>http://fedoraproject.org/wiki/Chromium
well, no. Advice on this llist over last year or so is that
google-chrome is better.
I can always fall back on firefox....
At least I know my problem is Selinux.
And in this case evidently something that can't be fixed.
I would think this will be viewed by many fedora users
as a real black mark on Selinux.
Unless google-chrome is at fault.
More detail on how I was running:
from a backup copy of F!4
I had just done a yum update.
If I now go back to my main F14
(and dont do the yum update)
then google-chrome works as it has been.
so it was some glltch in the yum update
Jack
12 years, 7 months
How to get both T520 trackpoint and touchpad working in F15
by Alexander Volovics
I am trying to get both trackpoint and touchpad of the Lenovo
T520 UltraNav working, preferably at the same time as under Windows 7.
cat /proc/bus/input/devices shows:
- SynPS/2 Synaptics Touchpad
- TPPS/2 IBM Trackpoint
After install of F15 the trackpoint works but not the touchpad.
The scroll feature of the trackpoint (hold down middle button
and move the stick) does not work.
After installing 'gpointing-device-settings' the trackpoint
can be configured so that scrolling with 'middle button & stick
does work.
I can however find no way to get the touchpad working.
This would make scrolling much easier.
Can anybody tell me the magic incantation.
Alexander
12 years, 7 months
difference between "ping -I INTERFACE" and "ping -I IPADDRESS" ?
by Franta Hanzlík
(sorry if this mail arrive in this list once more, I sent it
by mistake cca 90 minutes ago from unregistered e/mail address)
hello Fedora networking gurus,
I always thought that using ping with specifying source interface is
exact equivalent as specifying its IP address - but it is evidently
not true. What I'm getting on my Linux Fedora 14 i686 box:
# ping -I 10.128.254.2 -c 3 -nn 90.183.38.60; echo -e '\n\n';\
> ping -I eth1 -c 3 -nn 90.183.38.60
PING 90.183.38.60 (90.183.38.60) from 10.128.254.2 : 56(84) bytes of data.
64 bytes from 90.183.38.60: icmp_req=1 ttl=56 time=4.66 ms
64 bytes from 90.183.38.60: icmp_req=2 ttl=56 time=12.7 ms
64 bytes from 90.183.38.60: icmp_req=3 ttl=56 time=4.50 ms
--- 90.183.38.60 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 4.502/7.310/12.769/3.861 ms
PING 90.183.38.60 (90.183.38.60) from 10.128.254.2 eth1: 56(84) bytes of data.
>From 10.128.254.2 icmp_seq=1 Destination Host Unreachable
>From 10.128.254.2 icmp_seq=2 Destination Host Unreachable
>From 10.128.254.2 icmp_seq=3 Destination Host Unreachable
--- 90.183.38.60 ping statistics ---
3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 1999ms
pipe 3
Interface eth1 has IP address 10.128.254.2 :
# ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
2: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 1000
link/ether 00:30:4f:39:4b:49 brd ff:ff:ff:ff:ff:ff
inet 10.128.254.2/29 brd 10.128.254.7 scope global eth1
3: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:08:c7:25:c7:53 brd ff:ff:ff:ff:ff:ff
inet 10.3.60.10/24 brd 10.3.60.255 scope global eth2
4: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:08:c7:19:3b:94 brd ff:ff:ff:ff:ff:ff
inet 10.0.1.254/24 brd 10.0.1.255 scope global eth3
5: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 00:1e:8c:94:05:cd brd ff:ff:ff:ff:ff:ff
inet 192.168.0.254/24 brd 192.168.0.255 scope global eth0
6: ppp0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1492 qdisc pfifo_fast state UNKNOWN qlen 3
link/ppp
inet 90.187.57.21 peer 78.103.210.66/32 scope global ppp0
At all interfaces are only IPv4 addresses, they have not any IP aliases,
iptables are stopped. eth1 is NATed 1:1 to public IP at ISP site.
Know anyone why ping (from iputils-20100418-3.fc14.i686 package)
behaves in such way? May this be somehow related with system routin tables?
Thanks, Franta
12 years, 7 months
Developers responsibillity to Fedora Users
by Aaron Konstam
Alan Cox is exactly right that the users of Fedora products get them
free and one can make a strong case that therefore Fedora developers
have no responsibility to listen to user's complaints.
However, the Fedora users provide a service to the ReHat company of
identifying bugs that otherwise would show up to annoy the paying users
of RedHat Enterprise .
This is probably a weak argument to support the developers of Fedora
software listening to its users but what is clear is the current
situation leaves a bad taste in the mouths of the current Fedora
user-base. Clearly developers can ignore our complaints, but I have no
evidence that the paying Enterprise customers will be more tolerant of
the strange direction that RedHat is taking.
--
=======================================================================
timesharing, n: An access method whereby one computer abuses many
people.
=======================================================================
Aaron Konstam telephone: (210) 656-0355 e-mail: akonstam(a)sbcglobal.net
12 years, 7 months
installed but not installed.
by Joao Daniel Neves
So guys,
I need to install snort on a machine. It seems that snort need a library
called daq and libpcap version > 1.0
[root@localhost daq-0.6.1]# find / -name *libpcap*
/usr/local/lib/libpcap.a
/usr/local/lib/libpcap.so.1.1.1
/usr/local/lib/libpcap.so
/usr/local/lib/libpcap.so.1
/lib/lib/libpcap.a
/lib/lib/libpcap.so.1.1.1
/lib/lib/libpcap.so
/lib/lib/libpcap.so.1
So I guess I have libpcap-1.1.1 installed. (Installed by untar
./configure make make install)
When I try to install daq-0.6.1:
[root@localhost daq-0.6.1]# ./configure
--with-mysql--enable-dynamicplugin --with-libpcap-libraries=/lib/lib/
or
[root@localhost daq-0.6.1]# ./configure
--with-mysql--enable-dynamicplugin --with-libpcap-libraries=/usr/local/lib/
I got:
ERROR! Libpcap library version >= 1.0.0 not found.
Get it from http://www.tcpdump.org
It is normal? What Am I doing it corret? Btw: You can notice that I
installed twice.
12 years, 7 months