Linux.com

Community Blogs



openSUSE 12.1 milestone 5 (aka, beta 1) released

On September 1st, the openSUSE team released the latest milestone for openSUSE 12.1. This brings the openSUSE 12.1 release closer to replacing standard SysV init with systemd, and closer to GNOME 3.2. Check it out!

 

Newbie help needed! Computing with Linux on USB

G'day Community,

I am a Linux community newbie and this is my first post.  

I'm an engineer and work for a corporation which, despite it's many commendable merits, is constrained by a draconian IT policy that imposes upon us only the option of using an archaic 32-bit Windows XP OS.  Not to mention the wasted productivity and needless cost when a far superior Open Source OS is readily available, being forced to use 32-bit Windows XP is a major impediment preventing me from using the computer resources I have available to run the massive 3D modelling simulation problems I want to in order to better accomplish my work.  I appreciate our local IT guys are only enforcing the policies they've been given, probably without being asked their opinion on them, and I hope to find a work-around solution without rocking the boat.

 

Here's Plan A:

 

I understand Linux can be loaded onto a USB Flash drive and you can run the entire OS from the USB drive without ever actually installing it on the computer's disk.  The programs I want to run only require me to initiate them and direct them to the appropriate data files they'll read with commands through the shell; the programs don't require any GUI or need to be installed.  Once the programs are running, it's just a matter of a massive amount of number crunching for up to a few days using all the available CPU and RAM.  After the process is completed, I could transfer the computed data back to my Windows Laptop on the USB stick and then do all the visualization and analysis with the fancy commercial programs I have for Windows.

 

So, my first question is whether this Plan A is feasible.  I know that Linux would be able to run much better properly installed on the desktop's disk, rather than running it off the USB drive, but how adversely would this affect Linux's ability to fully utilize the computer's RAM and distribute computation among the 4 CPU on the Xeon chip?  It may be worth mentioning that the limiting factor on the size of problems I can run has a lot more to do with the amount of RAM that can be accessed, rather than the time required or speed/number of CPU.

 

The next question is, if running big computational problems with Linux on a USB is feasible and worth pursuing, which would be the best Linux distribution with which to do it?  Does it really matter which 64-bit distribution I'd use, or does it all just depend on the kernel?  I know the merits of different distribution scan bring up controversy and I hope that doesn't distract too much from the main reason for my post.  

Based on the web research I've done so far, I'm leaning towards Linux Mint or Ubuntu because they're both popular and reported to be good choices for newbies.  My friend runs big computational problems like the ones I want to on a Linux Beowulf cluster under CentOS.  He may have gone with CentOS for its network capabilities, which wouldn't apply so much to me because I just want to run the programs on a standalone desktop PC using all of its local CPU and RAM.  Despite that, it makes me think  CentOS is a good way to go just because it's what he's been using to run the same programs for years.

 

I thank the Community in advance for their thoughtful advice and support.

 

Jabood

 

 

 

 

 

 

 

 

Banshee vs Amarok (and the winner is)

If you are like me, you may have already spent a few years running Ubuntu Linux (what ever version) and then to find out the latest version 11.04 with Gnome 3 and Unity just didn't go over that well for ya!

Since I have discovered Ubuntu was not going to be my future operating system, I started to look around and trust me, I have found what I think to be a very good alternative to Ubuntu, it's called Kubuntu.

I am currently working with Kubuntu 11.04 with KDE so far not to many problems, I have had to update a bunch of packages, and go through the normal tweaks anyone would go through with configuring a new operating system to meet their personal needs, but so far have had nothing but good experiences over the last three-weeks.

Until the other day I'm thinking most if not all was looking good, and then I put a music CD in the drive to find out something very unacceptable was about to happened "I couldn't figure out how to play the CD" it took me up to an hour to figure out how to play the music CD I inserted in the drive (I was like WOW) you have to be kidding.

Back in the Ubuntu days with Banshee,  I would insert a CD and had music playing within seconds.  All the tracks would display within a very easy to use media player (it just worked really well) it would also work well with detecting my  iPod Touch (only the photos not the music files yet).

I have researched upgrading my Kubuntu 11.04 with Banshee and so far I see no problems with eliminating Amarok completely, and installing the latest version of Banshee.

In my not so humble opinion, the developers who work on Amarok need to take a few steps back, and rethink what they are doing!

Yes, as you already know, I was used to Banshee with Ubuntu, but when it takes someone that long (an experienced user at that) to figure out how to play a CD-Rom there is something really wrong with the application (the winner with flying colors is "Banshee") trust me, we all listen to music, and for most users I'm sure they want to have an environment that is reliable and easy to use.

 

Recursion in Bash-Shell Script



#!/bin/bash

## ----------
## This script will move all the TEXT files with name containing numeric only to path "/dump".
## If filename already exist at destination path, it will not move the file then.
##
## Log will be maintained containing path along with filename.
## ----------

VAR_BASE_PATH=/data
VAR_DUMP_PATH=/dump

LOG_NAME=$(date +"recursion_%d%m%Y_%H%M.log")

## ----------
## modify IF statement if
## source and destination path need to pass through arguments
## ----------

if [ $# -ge 1 ];then
    echo "wrong input, do not pass any argument"
    exit 1
fi

function SCAN_DIR ()
{
    ls "${1}" | while read line
    do
        new_path="${1}/${line}"

        if [ -d "$new_path" ];then
            SCAN_DIR "${new_path}"
        else
            echo "$line" | grep -qE "^[0-9]+[0-9].txt"
            if [ $? -eq 0 ];then
                echo "$new_path" >> ${LOG_NAME}
                mv -n "$new_path" ${VAR_DUMP_PATH}/
            fi
        fi
#        sleep 1
    done
##    echo "exiting function SCAN_DIR"
}

SCAN_DIR "${VAR_BASE_PATH}"

exit 0

## ---- END ---- ##

 

The new way to be - KDE

After working with Ubuntu Linux since version 7.04 I have a lot of experiences that were not all good, but overall, the operating system has been stable up until the latest version 11.04.

Yes, I understand that canonical wants to offer this new experience that provides a new look-and-feel, but in my opinion,  jeopardizing stability by turning an operating system inside out just does not make sense.

I feel Ubuntu overall at one time provided a great Linux experiences for anyone; even people migrating from Windows, but now, I have one thing to say - I love Kubuntu 11.04 I call it "the new way to be - KDE"...

 

 

My linux diary!!

How to save youtube without any external software!!!
First make sure that the video you want to download is open in the browser(i have tried this with firefox and chrome)
Doing this in firefox is rather simple..it can be copied from the browser cache!! it is present in the home directory /home/user_name/.mozilla/firefox/(random_text).default/cache/ and then use find(search for .flv) to get the flash video!!
But in chrome its kinda complicated..in earlier versions of flash players the vids used to be stored in the /tmp folder..but not anymore with the release of version 10.2 of  Adobe flash !!
anyways it can still be achieved
First open good ol' terminal and type either “lsof | grep Flash” or “ps x | grep flash”
The first command will give an output similar to the following


here you can see the process is “chrome” an the process ID (PID) is 4299 and the fd number is 33
now navigate to the file by typing
“cd /proc/process ID(the number)/fd(only fd not the value)”
here process id is 4299
now copy the file with fd 33 onto te desktop or the required destination with the command
“cp fd number /home/username/Desktop”
Thats it....you now have the file!! it is better to do this after the whole video has buffered to get the whole video!!
Now coming to the second command
Open the terminal again and type
“ps x | grep flash”
the output will be similar to this


here you can see the results..the first one uses libgcflashplayer.so..hence that is what we shall be using now!!
here u see only the PID number..in this case 4299
so we need to navigate to that folder
“cd /proc/process id number/fd”
here the command would be “cd /proc/4299/fd”
now list the directory and grep the flash file
“ls -l | grep Flash”


the output will be similar to the one above..here you can see that the fd 33 points to the deleted flashfile
in the tmp folder..this is the required file...copy it to the required destination!!!

 

How-to Virtualize a HP BL460c running SLES Linux 10 SP2

To begin with a bit of background on the environment may be helpful…


The need to virtualize my HP C7000 blade environment came from a requirement to consolidate our comms room estate, and retire out legacy hardware and achieve as good an occupancy on the remaining hardware as possible. The eventual plan for the left-over kit could be anything from a test-rig running Eucalyptus, or just a VMware ESXi environment running many virtual machines. – For now we are keeping it simple with a basic ESXi environment.


Most of my existing hardware is running on G1 or G2 blade kit, and I wanted to be able to just lift out the existing servers and place them in their new environment with as little disruption as possible, or developer time rewriting legacy code,etc, whilst I gave some thought to how I would rearrange my estate for maximum efficiency once all the services running in it had been virtualized, and made effectively hardware independent (within reason).
 
Here are the steps I went through, I’ve also listed a couple of gotcha’s that I wasted a bit of time on, but I’m glad I’ve thought of, so I wont be wasting time again!


I wanted to virtualize a system that was running on a HP BL460c(using its local storage not SAN or storage blades) and make it run under ESXi. I thought that this would be a simple case of connecting the ESXi cold clone CD to the blade and doing a few mouse clicks.

 This was how I proceeded, but I couldnt figure out initially why the blade was unable to see my ESXi server, even though all the correct routing between networks existed. - Then I remembered that I was running with 2 x Gb2EC network switches in the back of that c7000 chassis, and that I had had to use VLAN-tagging on all of the ports, this worked fine when the original blade OS  was ‘up’, but without the knowledge of the VLAN tags in the cold clone CD, this seemed to fail to work.


(If someone has done a cold clone in an environment where they have needed to tag the packets that are being sent from the cold clone mini-OS then I would love to have some feedback on how you did it.)


In the end I moved the blade from its original chassis and placed it in a c7000 enclosure with the VLAN-tagging disabled, and this worked great.


So I used the blade ‘SUV’ cable and connected a CD drive and keyboard and VGA screen to the blade and booted from the VMware ESXi cold clone CD, and went through the steps of identifying the ESXi system that I wanted to receive the image that the cold clone CD produced from the blade. 

I had a bit of a issue with the fact that parts of the configuration process for the cold clone environment seemed to require a mouse to click ‘Next’ as the tab key seemed to work intermittently (this could be a hardware/keyboard issue on my side), but just for reference its fine to disconnect the keyboard from the SUV cable and connect a mouse (and vice-versa) as many times as necessary throughout the installation. – Another approach which is probably possible is to connect the cold clone media using HP Virtual Media, but again I went for what was the most straightforward approach at the time.


Once the cloning process was complete I had the virtual version of the blade available on my ESXi host, but at this point it would still not boot successfully, as its expecting to see the Smart Array adapter in the blade, and so it tries to look for boot and root on /dev/cciss/c0d0pXX.
So from this point forward the files that I needed to edit on the Virtual machine image were the /etc/fstab, the /boot/grub/device.map and /boot/grub/menu.lst. 

You need to go through this and replace any reference to /dev/cciss/c0d0 with /dev/sdaX and so on. As an example here are some of my changes, which I applied by booting a liveCD and mounting each partition:
[/boot/grub/device.map]
(hd0) /dev/cciss/c0d0  —-> changes to  —>>(hd0) /dev/sda (note that there is no partition number specified)
[/boot/grub/menu.lst]
root (hd0,0)
kernel /vmlinuz-version root=/dev/cciss/c0d0p3 resume=/dev/cciss/c0d0p2
initrd /initrd-version
The above three lines changed to:
root(hd0,0)
kernel /vmlinuz-version root=/dev/sda3 resume=/dev/sda2
initrd /initrd-version
[/etc/fstab]
/dev/cciss/c0d0p3 /  –>changes to –> /dev/sda3 /
/dev/cciss/c0d0p1 /boot –>changes to –> /dev/sda1 /boot
/dev/cciss/c0d0p2 swap –>changes to –> /dev/sda2 swap

Next, I grabbed the SLES install CD/DVD and booted as if I were going to do an installation. I proceeded through the normal install steps up to where you are asked whether you are doing a new install,an update or ‘other options’. From other options you can run the System Repair Tool, and this analyses the installed system and advises you of any missing kernel modules, or ones that are now defunct (amongst other things). My CD advised me to disable debugfs and usbfs. I did not select verify packages, but only ‘check partitions’, ‘fstab enties’ and the final step rewriting the boot loader if needed.


Once the newly imaged server had booted I needed to delete the old network interfaces, and delete all entries in the /etc/udev/rules.d/30-persistent-net-names.rule, do a reboot, which automatically entered the new MAC address details for the new VMware ethernet adapter, then readded the network adapter in YaST.


After that I did a reboot, ejected the Install CD, installed VMwareTools on the Guest and I had my newly virtualized system operational again!
 
Matt Palmer 30-Aug-2011

 

Fake Ip address when use SSH with torify

When you try to connect to a server using SSH (secure shell) your ip will log in the server for example the log in here..

/var/log/auth.log

when our ip was log on targer server, its so dangerous, so know lets do a simple trick to fake our ip in the server log by using SSH, and the trick is we use Torify.. lets try

# torify ssh This e-mail address is being protected from spambots. You need JavaScript enabled to view it .1.7

So our Ip address will be anonymos, and lets check the log now

Aug 23 16:46:12 namaserver sshd[27034]: Invalid user admin from 192.168.1.8
Aug 23 16:46:12 namaserver sshd[27034]: Failed none for invalid user admin from 192.168.1.8 port 44194 ssh2
Aug 23 16:47:19 namaserver sshd[27034]: pam_unix(sshd:auth): check pass; user unknown
Aug 23 16:47:21 namaserver sshd[27034]: pam_unix(sshd:auth): authentication failure; logname= uid=0 euid=0 tty=ssh ruser= rhost=192.168.1.7
Aug 23 10:32:05 namaserver sshd[27034]: Failed password for invalid user admin from 192.168.1.8 port 44194 ssh2

and we succes to fake ip to login into a server using SSH, but our Ip still be logged in log, if we see in the red font its our IP, and the administartor of server know if our was log into his server, remeber,, use at your own risk, its only educational purpose :D

wassalam

 

Tux Paint Kids Summer Drawing Contest!

Hey all, Worldlabel is sponsoring a

Tux Paint Kids Summer Drawing Contest

Grab Tux Paint, make a cool drawing, win one of 3 OLPC laptops, one of 10 Sugar-on-a-stick and other awesome prizes!

If you're not familiar with Worldlabel, the Worldlabel blog runs a lot of great Linux howtos.

The 2011 Tux Paint Summer Drawing Contest is sponsored by Worldlabel.com and is open to all children aged 3 to 12 who live anywhere in the World!

Here’s a chance to show off your talent using a great drawing program made especially for kids. Tux Paint is an award-winning drawing program you can download to your computer. Tux Paint was recently awarded SourceForge.net Project of the Month. It will run on all versions of Windows (including Tablet PC), Mac OS X 10.4 and up, Linux, FreeBSD and NetBSD. And it’s FREE!

 

PRIZES: Worldlabel.com will give out prizes to 10 winners! 1st prize wins a OLPC notepad computer, Sugar-on-a-stick loaded with Tux Paint, a Tux Paint T-shirt and button. 2nd and 3rd wins a OLPC computer, Sugar-on-a-stick and a T-shirt. 7 more winners will be chosen and will receive a Sugar-on-a-stick and a Tux Paint t-shirt.

HOW TO ENTER:

  • Download Tux Paint
  • Make your drawing in Tux Paint and save it in png format
  • Send your finished drawing in png format to This e-mail address is being protected from spambots. You need JavaScript enabled to view it and include “Tux Paint” in the email subject line
  • In the email submission include: 1) the artist’s’ name 2) the artist’s age 3) the title of drawing 4) the country where the artist lives
  • All artwork must be the contestant’s original work created on Tux Paint.
  • Only one entry per child

Entries will be judged on the quality and originality of the artwork. Extra points will be given to drawings that tell a story.

Entries must be submitted by midnight USA Easter Standard time on 12 September 2011. Winners will be announced no later than 22 September 2011.

All entries will be licensed: Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported and will be exhibited on this page.

Contest Judges
Linda Goin
Dmitri Popov
Marguarita Suti

 

Visit Tux Paint Kids Summer Drawing Contest for complete details!

 

Dropbox, not exactly single sign on but useful anyways

In our house we have one PC running Fedora 15 and one laptop also running Fedora 15. Up until now the laptop has been my machine only, no kids allowed but I am really sick of frying nuts off on the sofa and want to get some serious stuff done which would be better suited to a PC. Problem with the PC is that the kids always want on it, solution, create them accounts on the laptop, job done? No!

Even with accounts for the kids I was still getting nagged because none of their stuff (minecraft saves) were n the laptop. No problem, copied them over, easy as, but the next issue then was synchronizing those minecraft saves. I was considering flushing them through to a little HP Microserver running Ubuntu Server 10.10 but did not have the time, enter Dropbox. I saw this somewhere else but forget where but quite simply via cli in the dropbox directory:

ln -s /home/annoying_kid_name/.minecraft/saves mcsaves

So now it does not matter if the kids log into the PC or the laptop, Dropbox keeps the minecraft saves current on both machines :-)

This works great for other application settings to, I do the same thing for Getting Things Gnome and am busy thinking up other stuff to sync just for the sake of it.

It is hardly single sign on but it works, I do miss the off line files feature of Windows Server!

 

Configuring Dell EqualLogic PS6500 Array to work with RedHat Linux 6 EL

I decided to write the following post after having some problems getting iSCSI connectivity to work correctly with a Dell EQL PS6500 Array with RedHat 6.

It seems that Dell have done a great job in getting the Host Integration Tools to work with RH5.5 and ESXi and also the MEM for MPIO and I love the product, but I encountered some problems when trying to install a RH6 server and connect it all up following the docs on the Dell site. The main issue I had straight way that I was predominantly using SuSE SLES as my preferred Enterprise distro, but the RPMs provided by Dell for the HIT tools and MPIO had a load of dependencies that needed to be resolved before it was even possible to start using the extended functionality that these tools offer on SuSE.

So I downloaded a version of RH6.1 to test the new tools on, only to find that this didnt work as intended. After a lengthly support call, I was told that although the documentation said that it supported RH6 what this actually meant was 6.0. – So I downloaded 6.0 and had exactly the same issues…

So I did some digging around and debugging of the installation procedure and docs. The first thing that the docs tell you to do is make sure that you are at the latest supported release of 6 and to perform a yum_update. – This in itself is a problem, as it effectively takes the 6.0 installation and makes it 6.1. I tested this once I had a working 6.0 installation by doing the yum_update, and it completely broke the ability to address the iSCSI devices properly using the Dell tools. I found this a bit worrying, particularly if you are sharing your admin roles with someone else, they could inadvertently break the entire configuration.

The instructions for actually formatting and adding the device to the system could use some more detail.

The documentation(for RedHat MPIO on EQL) states as a final step that you need to do the following(this is entirely absent from the HIT tools docs):

mke2fs –j –v /dev/mapper/rhel-test

this doesnt work at all using the HIT tools and tells you that the process could not read block 0, and gives you all sorts of wonderful messages about not being happy with the superblocks on the device. – This doesnt happen if you dont use the tools, but just use Linux native MPIO.

The only approach to this that worked was by trial and error on my part (which was very time consuming) was as follows. Here’s my checklist:

 

Configure SCSI on the local onboard NICS on a dedicated DELL R710 and set 4 paths (edit the /etc/equallogic/equallogic.conf file and change the [MPIO] section to contain the maximum amount of path (NICS) you intend to use) – If you dont do this you could have problems in the future as for each NIC path you are given a corresponding /dev/sdX device which sits behind the mapper tool.

Some issues with the Dell HIT tool for EQL it doesnt work well on 6.1.

  • Yum update from 6.0 breaks a valid config as it effectively takes the server to 6.1!!!
  • Ignore the doc, dont do a localinstall of DKMS,EQL and iscsi-initiators. Also dont grab the latest version of DKMS as it is broken even though its available on the Dell site. – at the time of posting I used dkms-2.1.1.2-1.noarch.rpm, but had problems with dkms-2.2.0.0-1.noarch.rpm.

Grab kernel-devel and gcc, gcc-headers using yum
Configure iscsi.conf and CHAP. – enter in here the CHAP password you set on your EqualLogic
Enable iscsi logins in /etc/rc.local
Run eqltune -v and run through checklist and make the necessary alterations to the kernel config,etc. – This tool is your friend!

Run ehcmcli -d to show valid paths and sessions (you should see 4 paths here if you set your MPIO settings in /etc/equallogic/equallogic.conf  to 4).

Run rswcli -E -network <ip> -mask 255.255.255.0 to exclude the public NICS from accepting broadcast traffic from the EQL tool.
Use iscsiadm to discover the new LUNS and to log in the EQL LUN.
Next look in /dev/mapper for the eql-xxxxxxxx-volname LUN id. Make a note of its true dm-X number
To format the disk do not use the MPIO device. Its necessary to format the sdX devices that are available on each session. for this reason as well it means you need to set the config ahead of time at its maximum. It wont create more sessions as they are needed (this will break the LUN!!!). 
do this in /etc/equalogic/eql.conf

Run ehcmcli to find out which sdX devices are underneath the MPIO layer.
next run:
kpartx -a /dev/dm-X (where dm-X is the dm id associated with the eql LUN and vol name)
sfdisk /dev/sdXX (do this for each sdX)
kpartx -a /dev/dm-X
Next: mkfs.ext3 /dev/mapper/eql-lun-vol-part
mount /dev/mapper/eql-lun-vol-part

I’ve also included my working multipath.conf file from my attempts to use native MPIO on RH6.1 and not the Dell tools. You will note that the way that the scsi tools (on RH6.1) interrogate the device has changed slightly and it now expects to see SEQLOGIC not EQLLOGIC, which could explain why the yum update breaks the tool.

There is also the suggestion to do the following in the lvm.conf file, but this renders you install unbootable if you are using LVM on your main filesystem.

filter = [ r|/dev/mapper/eql-[-0-9a-fA-F]*_[a-z]$| ]

/etc/multipath.conf

defaults {

        udev_dir                /dev

        polling_interval        10

        path_selector           “round-robin 0″

        path_grouping_policy    multibus

        getuid_callout          “/lib/udev/scsi_id –whitelisted –device=/dev/%n”

        prio                    const

        path_checker            directio

        rr_min_io               100

        flush_on_last_del       no

        max_fds                 8192

        rr_weight               priorities

        failback                immediate

        no_path_retry           fail

        queue_without_daemon    no

        user_friendly_names     yes

        mode                    644

        uid                     0

        gid                     disk

}

blacklist {

        devnode “^sd[ab]$”

        devnode “^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*”

        devnode “^hd[a-z][[0-9]*]”

}

#blacklist_exceptions {

#       devnode “^dasd[c-d]+[0-9]*”

#       wwid    “IBM.75000000092461.4d00.34″

#}

multipaths {

        multipath {

                wwid                    36090a0a890d37ea5f1df5414000040ac

                alias                   MyRedHatVol

        }

}

devices {

 device {

        vendor “SEQLOGIC”

        product “100E-00″

        path_grouping_policy multibus

        getuid_callout “/sbin/scsi_id -p 0×83 -gus /block/%n”

        features “1 queue_if_no_path”

        path_checker readsector0

        failback immediate

        path_selector “round-robin 0″

        rr_min_io 10

        rr_weight properties

}

}

 

I’m sure theres other ways to sort this out, but the above checklist is what worked for me..

 
Page 2 of 116

Upcoming Training Courses

  1. LF331 Developing Linux Device Drivers
    03 Jun » 07 Jun - Virtual
    Details
  2. LF411 Embedded Linux Development
    24 Jun » 28 Jun - Silicon Valley
    Details
  3. LF422 High Availability Linux Architecture
    15 Jul » 18 Jul - New York
    Details

View All Upcoming Courses


Who we are ?

The Linux Foundation is a non-profit consortium dedicated to the growth of Linux.

More About the foundation...

Frequent Questions

Join / Linux Training / Board