Coding, coding, coding....

English

English language

Dropbox fuss

Posted Sun, 07/10/2011 - 13:48 by artur

I am not even talking about the password-less access to the Dropbox data ;-). A mistake can happen to everybody and bugs are in every code. Much bigger concern is the fact that data are not encrypted by default so in such cases there is no protection.

But now, Huston we have got a problem, a bigger one.

Ok, not everybody knows about it and not everybody is interested. However those who use Dropbox might want to know that Dropbox have just changed their terms and conditions. Maybe it is not even exactly as most people say that you basically agree Dropbox can do whatever they want with your data but it is pretty close. For me it is too close, close enough to close my Dropbox account.

But, hey are there any alternatives? We have been looking for a while and there is nothing what would really be good enough. However, we are software developers so maybe instead of looking for alternative we could create one? Looks like a lot of work but also a lot of fun too.

So, there is the project: https://projects.tigase.org/projects/syncbox If you are interested in joining us, drop me a message.

JVM memory management under VMs

Posted Thu, 05/26/2011 - 03:24 by artur

I wonder if anybody has ever experienced similar problem as we do in our Tigase project.

The same Java application (not necessarily Tigase server) which works very well, using relatively little memory, like no more than 10MB on a dedicated machine on Mac OS X or Ubuntu goes wild and uses hundreds of MBs on VM, specifically OpenVZ.

Even if you assign 1GB for JVM on 2.5GB instance the JVM seems to be allocating the whole memory rendering machine (VM) unusable after a while.

Setting max memory limits with the option:

-Xmx1000M

Mac OS X - too many open files....

Posted Sat, 03/14/2009 - 21:22 by artur

This is really annoying. Why something has to be simple if it can be complicated?

For some reason on Mac OS X commands: 'ulimit' and 'sysctl' works fine but are actually useless. Don't count on them if you want to change maximum number of open files in your system. Fortunately this forum threads comes to help. To save you from reading through all of this here is how it goes:

To check limits on your system run: 'launchctl limit'. To change max number of open files run: 'launchctl limit maxfiles 400000 unlimited'. To change the setting permanently add to the file: '/etc/launchd.conf' following line:

limit maxfiles  400000           unlimited

This doesn't however work for maxproc setting and please don't ask my why. I am asking...

Queues processing problem, any suggestions?

Posted Mon, 02/16/2009 - 12:04 by artur

Problem description

Let's say we have N queues with packets waiting for processing. Queues are indexed from 0..N-1. Queue no 0 is the highest priority. Queue no N-1 is the lowest priority. Packets are being added to all queues asynchronously all the time and there is one thread reading packets from the queues.

Question

How to efficiently empty all the queues in a single thread and make sure packets from the highest priority queues are always processed as soon as possible.

Starting point

// Queues are kept in a map as below.
// EnumMap<Priority, LinkedBlockingQueue<Packet>> queues
while (! stopped) {
  try {
    // Your code starts here:
    ................
    // Your code ends here.
    // Let's make sure there was nothing added to any queue in the meantime
    synchronized (queues) {
      boolean added = false;
      for (LinkedBlockingQueue<Packet> tmpqueue : queues.values()) {
        if (added = (tmpqueue.size() > 0)) {
          break;
        }
      }
      if (!added) {
        queues.wait();
      }
    }
  } catch (Exception e) {
    log.log(Level.SEVERE, "[" + getName() +
      "] Exception during packet processing: " + packet.toString(), e);
  } // end of try-catch
} // end of while (! stopped)

Any suggestions are very welcomed.

This is why I advise to use Linux instead of Windows

Posted Sat, 11/15/2008 - 10:25 by artur

 Have a look at this article about increased DDOS attacks on the services driven by the bot nets. In fact bot nets drive attacks but the real vehicles they drive are millions of Windows machines over the Internet.

Linux might be not the friendlies operating system yet. There are problems with hardware yet which make it difficult to use sometimes. But maybe defending yourselves and others from intruders is worth the extra effort. On the other side I am sure the more of us use the Linux the more hardware vendors add Linux drivers for their hardware.

Recompiling emacs *.el files

Posted Thu, 05/15/2008 - 11:36 by artur

Sometimes, when you change the Emacs version and you have own or custom Emacs packages installed and compiled with the previous version you may get unexpected behavior, including invalid function c-point warning message. The best solution for this is recompiling your *.el files using the current Emacs version:

Remove all old *.elc pre-compiled files:

find site-lisp/ -name "*.elc" -print | xargs rm -f

Recompile all Emacs source code files:

emacs --batch --eval "(byte-recompile-directory \"site-lisp/\" 0)"

Ever needed to do a Bash loop?

Posted Wed, 05/07/2008 - 19:19 by artur

The simple bash loop to do something with all files in the directory is:

for f in * ; do echo $f ; done

which just displays all files in this case.

This is easy, what I usually need and often forget how to do it is to execute some action exact number of times. Something like simple for loop in C or Java. And there is an exact match for such loop in Bash too:

for (( i=1 ; i<=100 ; ++i )) ; do echo $i ; done

I found another similar solution on the Internet today at spiralbound.net:

for i in $(seq 1 100); do echo $i ; done

which might useful in some cases...

Mail in Mac OS X driving me mad

Posted Wed, 04/09/2008 - 20:46 by artur

 I used to use KMail for years. It had some issues especially with IMAP accounts but worked fine for the most of the time and problems could be easily avoided by careful usage.

The Mail however in Mac OS X is completely different story. It is quite stable and better at using the IMAP accounts but it is consistently annoying in certain places.

Gentoo on VMWare 1.0

Posted Sun, 03/16/2008 - 23:56 by artur

Well, the installation went smooth and without any problems. I have made one mistake though. For some unknown to me reason I selected Mac UK keyboard as one of final settings. After restart there was no way to login or change the  settings. Now reinstalling Gentoo again.

Very short guide for those who are interested how to install Gentoo in less then 30 minutes:

  1. Get the livecd-i686-installer-2007.0.iso or more recent image if it is available. Just make sure you download the full live CD not the minimal version.
  2. Setup the virtual machine in VMWare and point it to the ISO image as an installation disk. After you finished setting it up VMWare tries to run it automatically. Don't let it to do so.
    • Depending on your needs set proper HDD size. It doesn't need to be very huge as you can always attach another virtual HDD later on. On the other hand HDD in VMWare starts at zero size and grows when it is needed up to the size you set. So in theory you can set quite huge size. I set 20GB for my installation.
    • I would recommend a least 1GB RAM. But again it depends what your are going to do with the Gentoo installed.
  3. Stop it and go to settings and at least adjust memory settings. Defaults are usually quite low. I set 1.5GB for the Gentoo as my Macbook has 4GB.
  4. Now, after you adjusted your all settings (in my case VMWare always crashes at least once) start virtual machine and let it boot from the ISO image.
  5. The best and quickest way to install it is to use Networkless installation mode provided by the GUI installer. But before you run it I would recommend to setup partitions on your hard drive manually as the defaults offered by the installer are not the best for my preferences. My preferred layout (for private desktop, workstation) is: 100MB /boot partition, 2GB swap and the rest of hard drive for / - the rest of the system including home and var directory. On the server I usually set a separate partition for /home. Here is a step by step guide how you set partitions for your installation:
    • Browser menu: Applications -> Accessories and click Terminal
    • Terminal opens so set the root password to whatever you like using command: sudo passwd
    • When the new password is set switch to root user with command: su - and when asked enter the password you just set
    • Set your hard drive partitions with fdisk: fdisk /dev/sda
      • 'n' - creates a new partition, when asked what type of the partition to create answer 'p' - primary, and then press '1' - the first partition. It asks you for the first sector number, press Enter to accept default. It asks you then for the last sector number or the size of the partition, enter: +100M - 100 MB size as this is your boot partition.
      • 'n' - creates next partition, when asked about partition type answer 'p' (primary) again and press '2' - the second partition. Accept the default first sector and enter +2000M (2GB swap) as the size (last sector).
      • 'n' - creates your third and last partition, again 'p' for primary partition and '3' - the third partition. Accept the default first and if you accept the default for the last sector the rest of the whole hard disk will be allocated.
      • Change the second partition type from the default Linux to Linux swap by pressing 't' and then select the second partition by pressing '2' and when asked for the Hex code enter 82.
      • You can now press 'p' to display your partition table to make sure everything is set as it is expected.
      • 'w' to write your new partition table and exit fdisk.
    • Now you have to create filesystems on your new partitions:
      • mke2fs /dev/sda1 - creates ext2 filesystem on your /boot partition
      • mkswap /dev/sda2 - creates swap on your second, swap partition
      • mkreiserfs /dev/sda3 - creates Reiserfs file system on your third / the system partition

Now you can run Gentoo Linux Installer (GTK+) and if you select Networkless installation you have Gentoo system setup in less then half an hour.

Linux on Macbook?

Posted Sun, 03/16/2008 - 16:52 by artur

Well, I am not really sure whether I install Linux on Macbook as a primary OS. However I miss the days when I used Linux as my development platform and there are some stuff in Mac OS X I just can't get used to.

So the day has come and I am installing Gentoo inside VMWare Fusion. The Macbook Pro has enough power to run both at the same time and with 4GB RAM on board there is enough for both systems. I hope this was I can use benefits from both worlds without sacrificing anything. On top of that I normally use 2 screens - one built-in the laptop and the second on the external monitor. This way I can use both system in full screen mode.

I tried both VM available for Mac OS X: Parallels and VMWare. I wanted to install amd64 Gentoo version. Parallels doesn't support 64bit systems at all so it lost at the beginning and it hang a few time so hard, I couldn't even kill -9 it. Well, this is something for OS to blaim for... VMWare claims it does. It even boots system from CD. During installation however it hangs too. The CD is not broken, nor the installation program is as www.tigase.org has been installed from this CD.

The Gentoo is installing right now in VMWare, let see how it goes...