Linux.com

Feature: Linux

The stallion and the penguin: DreamWorks uses Linux to create new animated film

By on April 24, 2002 (8:00:00 AM)

Share    Print    Comments   

- By Matt Butcher -
In late May, DreamWorks' new animated film "Spirit: Stallion of the Cimarron" will hit theaters and mark a major milestone for the studio, as well as for the Open Source community at large. "Spirit" was created on Linux workstations as well as a Linux rendering farm.
While "Shrek" and other movies including "Lord of the Rings" have used Linux to power server farms, the creators of "Shrek" also used IRIX on SGI workstations. So "Spirit" is DreamWorks' first animated feature using Linux both on the front and back ends.

Pacific Data Images (PDI), the animation co-production arm of DreamWorks SKG, is best known for its cutting-edge animated films "Shrek" and "Antz," and it pioneered computer-assisted animation and 3D rendering using high-powered SGI servers and workstations. But as the hardware began to show signs of age, PDI/DreamWorks Animation looked for a better platform, according to Scott Chapin, with DreamWorks animation technical support.

The company needed a system that was reliable, scalable, and capable of high performance on the desktop -- and system that was cost-effective to maintain and used commodity, Intel-based hardware. This new platform would replace not only the the back-end "render farm" of servers, but also the desktop workstations of the artists. After evaluating a wide range of solutions, including Windows 2000 and Mac OSX (which was still in beta at the time), PDI/DreamWorks Animation settled on Linux on Hewlett-Packard graphics workstations. (More on the HP connection in the sidebar below.)

"When we evaluated potential systems, Linux presented its own set of problems. It was not quite ready for our desktop environment," Chapin says. But, he continues, "efforts from HP and Red Hat met those needs."

PDI/DreamWorks Animation replaced its entire "render farm" with x86-based servers running Linux. For "Spirit," the company created a Linux cluster for back-end rendering. Over the months, the cluster has grown to its current size of about 500 CPUs. These servers handle the nitty-gritty work involved in creating what PDI/DreamWorks Animation calls "tradigital animation" -- the blending of 2D and 3D animation. DreamWorks says tradigital animation combines the best of two worlds, leveraging the visual power of 3D animation, but at the same time preserving the tradition and art of 2D animation.

Under the previous architecture, generating the 3D graphics was such an intense process that it took more than three hours to render a single tradigital scene, costing animators serious time even when only small changes were made. The switch to Linux, though, offered big returns as rendering was cut from three hours down to nearly real time. This improvement in speed gave artists the opportunity to focus on their art, not the process of generating it.

Servers were only one piece of the puzzle, as PDI/DreamWorks also migrated all of its workstations to Linux as well. Using Linux as a desktop environment for artists was a challenge. Initial problems arose with the X server. At the time, XFree86 did not meet the performance needs of DreamWorks artists. HP offered to port its own X server to Linux to serve as an interim solution -- a decision that just may have been the deciding factor for DreamWorks, Chapin says. As the XFree86 project ironed out a few wrinkles, PDI/DreamWorks migrated back from HP's X server to XFree86. HP and Red Hat have continued to offer support services to DreamWorks, tackling problems ranging from efficient installation of new workstations to kernel timing issues.

With desktop performance and stability achieved, PDI/DreamWorks Animation began working on applications. DreamWorks uses a wide array of tools for the production of films, ranging from unadorned and straightforward drawing programs developed internally to Alias|Wavefront's wildly popular Maya 2D/3D modeling engine. The transition to Linux required that PDI/DreamWorks Animation port all of its own tools from SGI. At the recent National Association of Broadcasters' show in Las Vegas, Chapin demonstrated the Linux version of PDI's 2D sketching program, an animation tool, and a piece of hardware called ToonShooter. ToonShooter has a camera precariously mounted a couple of feet above a drawing board. Artists first sketch on paper, and then slide the paper through ToonShooter, where the image is digitized and animated on the fly. From that point, the artists can easily work with those same images on their workstations and quickly integrate those images into existing scenes, saving many animators many hours of work.

Sequences of drawings can be rapidly captured and stored, preserving the transition of animation from paper to pixels. Ultimately, ToonShooter is a means for PDI/DreamWorks to meet its goal of "conserving trees" while providing artists with a better way of creating animated scenes, Chapin says.

Third-party tools presented a bigger porting challenge. Few of the high-end commercial graphics tools supported Linux out of the box. Together, HP and PDI/DreamWorks worked to convince Alias|Wavefront and others that they needed to port their applications to Linux. Ultimately, HP and PDI/DreamWorks Animation were successful, and DreamWorks has fully integrated Linux versions of all of its major tools including Maya and Wacom's Cintiq interactive pen display.

DreamWorks is quick to point out that, in the words of one DreamWorks representative, "We are not Linux zealots. DreamWorks just wants to tell the story." For the company, Linux and an Open Source platform provided the best way for them to accomplish their aims.

Chapin relayed a cheerful account of the cooperative nature of the Open Source community, pointing out the work of HP, Red Hat, and many other hackers who provided, improved, and maintained the tools that ultimately enabled DreamWorks to transition to an almost 100% Linux shop. "And when we can," he says, "we try to feed our kernel and video changes back into the community."

DreamWorks seems to understand the concept of community embodied in the Open Source movement. The company saw that its needs for reliability, performance, and scalability were met. DreamWorks also recognized that the areas where Linux didn't meet its needs could be overcome because the source was available and the vendors were willing to help. The release of "Spirit" will represent a success for both DreamWorks and the Open Source community, which proved the viability of the Open Source model to an industry that has been dominated by proprietary and closed-source products.

----------------------------------------------

The HP/DreamWorks connection

In January, DreamWorks and Hewlett-Packard signed an agreement to collaborate on several animation initiatives, says Mike Balma, Linux solutions strategist for the HP Linux Business Development Organization.

That agreement has resulted in the centerpiece of the increased Linux presence in the making of "Spirit," the HP workstation x4000 running Linux. "Linux came up as an opportunity for [DreamWorks] to have relatively a seamless port from IRIX," says Jeff Wood, product marketing manager for personal workstations in the HP Technical Computing Division.

HP's tech staff, which has experience with the company's own seven generations of graphics solutions, also helped DreamWorks get 3D acceleration in Linux from an unimpressive three frames per second rendering speed up to a speedy 46 frames per second, Wood says. HP and DreamWorks also worked together to create accelerated 3D on two Linux screens at the same time, he adds.

DreamWorks is now running about 600 workstations on Linux, using HP's proprietary graphics hardware, Wood says.

Two other studios are now starting to deploy x4000 workstations for animation, Wood adds. Look for HP announcements soon.

Balma says HP and DreamWorks are also working together on some futuristic technology initiatives, such as movie-making packages for consumers. Those projects may or may not be based on Linux.

-- by Grant Gross

Share    Print    Comments   

Comments

on The stallion and the penguin: DreamWorks uses Linux to create new animated film

Note: Comments are owned by the poster. We are not responsible for their content.

A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 01:32 AM
How much are the open source "community" paid for this?

We have yet to see working sucessful business-stories around Linux and open source. Instead we see companies going out of business and people loosing their jobs.

This is just a story of a company taking advantage of work others have given away for free.

Isn't open source supposed to be an alternative businessmodel, not just free labour?

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 01:41 AM
We have yet to see working sucessful business-stories

This is a working successful business story! In fact, all the announcements you have been hearing recently from banks and major corporations are wonderful success stories. OK, not successful for companies wanting to sell proprietry software, but successful for integrators - you think HP and RedHat make are involved in these projects for free?

The IT business is changing. The clever guys realise the future is all about integration. Change or die.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 02:21 AM
They are getting paid exactly what they asked for.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 02:51 AM
"Together, HP and PDI/DreamWorks worked to convince Alias|Wavefront and others that they needed to port their applications to Linux. Ultimately, HP and PDI/DreamWorks were successful, and DreamWorks has fully integrated Linux versions of all of its major tools including Maya and Wacom's Cintiq interactive pen display."
If you go to the Alias website you'll see they do actually offer a linux version now. I think this is a good thing considering it could help linux become a real option for graphic designers.

#

I think that's the payoff

Posted by: Anonymous Coward on April 25, 2002 11:52 PM
An OSS customer that's so important in its market that the third parties have to accomodate it. Here's Dreamworks _telling_ their software suppliers "We want it on Linux", and the suppliers having to listen. That kind of market power alone is worth whatever work went into the project. RH & hp know this, and are fully entitled to crow over this major success. This is one market that is NOT 0wn3d by the Empire, which is _exactly_ what OSS needs right now.

This is a very far cry from what happend a couple of years ago when the Civil Engineering consultants I was working for tried to get the Bently (Microstation mechanical CAD) people to port their UNIX code to Linux. Their response was that they literally had maybe a dozen requests for such a product. At $50K each (the going price for a MicroStation license), this represented $600,000. We offered to do the port for them, we figured that if we could get the UNIX source (under NDA, if that's what it would take) we could recompile it for Linux in way under a man-year. We offered them _free_ development, in exchange for, at most, a couple of licenses for the finished product. Bently totally refused to even listen.
The mechanical CAD market _is_ 0wn3d by the Empire.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on May 08, 2002 03:48 AM
hey,
i just wanted to say, i AM a computer graphics designer. and i do use linux. there are still some design isues to overcome but i think that on the whole, it is amaseing what they have done so far. and with the head companies putting their weight behind the codeing of porpritary and opensource software we are going to see what they have been pioneering within our own linux distros within the next 2 to 3 years!

the cool thing about linux is, it can actually handle the heavy work load of rendering without crashing. you can now do on a free os what use to cost a ton of money. when i build my axnimation studio i plan to build it from the ground up with linux.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 09:36 AM
Maya for Linux isn't free. It's the same price as the Windows and SGI versions, AFAIK.

 
As for the other tools, well, if you read the article carefully instead of trying to push your anti-open source agenda, you would see that they were developed internally (by programmers who I'm sure were well-paid for their work). So it turns out that you can make money while using an OSS/GPLed OS at the same time!

 
Is it just me, or have all the pro-Microsoft trolls all moved from Slashdot to Newsforge? I guess they have to keep spreading their FUD while the blackout is in effect...

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 01:17 PM
Maya isn't free but it is now available. And that is GREAT. Yes it would be nice if it would be free because you wouldn't have to pay for it. But it costs and it is closed source. Is that a reason for NOT creating a Linux version?

This is what some Linux people should think about a little more.

Availability is the on of the best features software can have. Linux won't be supported by those who use the great software developed by some companies: Adobe, Alias|Wavefront, NewTek and many more. When everything gets ported, costs it or not, open or close it will be a boost of Linux community. And thus Linux could replace Windows completely.

Open-source (and free price) is what operating system should be and Linux is.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 26, 2002 01:23 AM
I think you misunderstood the meaning of my post. I was replying to the guy saying that OSS/GPL is not a viable business model, blablabla. I replied that Maya is proprietary, even though it works on a GPLed OS. Meaning that it is possible to make money on the Linux/OSS platform, i.e. closed- and open- can coexist, unlike the blatant lies propagated by Microsoft on this matter.

#

Thats odd

Posted by: Anonymous Coward on April 25, 2002 10:14 AM
How many of the OSS companies are going out of business. I watched a large number of Dot-coms go bust. But when I looked them up, almost all were MS shops. A few were SUN, a couple were IRIX. I saw the fewest of Linux and BSD. Yet Linux/BSD account for more total sites than does MS. I have also seen some Linux companies change their focus and die (Coral comes to mind). Considering that all high tech companies are dieing at a faster rate than do the Linux companies, I would say that Linux/OSS is oding just fine.

#

Re:Thats odd

Posted by: Anonymous Coward on April 25, 2002 09:19 PM
That's probably because OSS companies realise they have to work within a constrained budget while M$ technology based companies rely too much on the name Windows for their marketing.

#

Re:Thats odd

Posted by: Anonymous Coward on April 26, 2002 06:04 AM
You might want to consider the fact that, for Corel, as far as I know Microsoft bought a large share of them. This might have change their relationship with open source, not to mention the common strategy of 'buy and kill'. It might be quite a different issue here with that particular company.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 02:22 PM
Come on.. perfect case to point out: Apple Computer. Apple has benefitted majorly from both unix and from open source. Look at how far along their FreeBSD/Darwin based OS X has come in just a year's time on the market with all the help from the open source community? That operating system has given Apple the tools it needs to expand and remain competitive in the OS arena. Their old system was a major impediment to both developers and users who had to fight its limitations. Now getting with a mostly open-sourced Unix OS, Apple is forging right ahead and making major headway not only against Micro$oft, but more importantly for open source and for their platform. It was a wise business move for Apple, one that will be paying them back well in the coming years with the portability of apps between unix systems, and one that will well profit other companies that make a similar move to Unix (as developers or end users).

Unix and open source are the way. So the business model is different: More of the profit relating to the distribution of the OS will be going to hardware manufacturers and less money will be shelled out by the end users (for the OS).. Are end users going to complain? No, I think not. People need a cheap viable universal operating system where they have an opertunity to be involved in its design and it doesn't cost a fortune to implement. M$ can kiss our *nix!

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on May 02, 2002 11:21 AM
Correct me if I am wrong...but Apple no longer really competes with MS, as it is OWNED by MS, or was the whole thing cancelled? Last I knew that deal was done.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 25, 2002 05:01 PM
Ask HP and Redhat. Giving away the basic tools for free, then charging for consultancy, training and support is exactly how open source is meant to work. Not to mention selling some boxes in HPs case.

Sure you won't make shedloads of money. You have to keep doing new stuff to keep the revenue stream running.

Nobody says the PC hardware industry is failing because there are a large numbers of suppliers selling at small margins. Tough for them, good for the rest of us. Why shouldn't it be that way for the software too?

#

Re:A major milestone for open source?

Posted by: ronybeck on April 25, 2002 07:36 PM
Are you serious? The great thing here is that two large companies were using Linux and open source in a large scale real world project. Too many companies over look the real potential of linux and Open source. It also shows how some one can actually make a profit from it. Back yard programers don't make distro's like Red Hat or Software like Star Office. If big Ccompanies didn't look at and use open source then they wouldn't contribute some thing back to the users of open source.

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 26, 2002 11:31 AM
I'll bet when your mom baked you a cack you complained 'cause it wasn't chocolately enough, or done fast enough for you didn't you?

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on April 26, 2002 12:23 PM
> Isn't open source supposed to be an alternative
> businessmodel, not just free labour?

i am very sure the project is not a free labour!
RH is not that stupid to works for free :)

#

Re:A major milestone for open source?

Posted by: Anonymous Coward on May 09, 2002 10:14 AM
Not sure where people are getting this its all free from, open source does not = free. The linux companies involved would have charged for their own programmed apps, the manuals, tech support, most likely training and all the other support.
Nothing comes for free

#

IREX

Posted by: Anonymous Coward on April 25, 2002 01:54 AM
Last I checked, it's IRIX, not IREX, just a side note... Otherwise, it's good to see Linux gain some credibility beyond the borders of geekdom and in the public eye.

#

Re:IREX

Posted by: Grant Gross on April 25, 2002 02:57 AM
Thanks for pointing that out. My bad -- yeah, it's IRIX like Unix, duh.

Grant

#

Re:IREX

Posted by: ggw- on April 25, 2002 11:04 PM
One doesn't know how to spell one of the best OS in the world, the other publicly displays his ignorance. What a slap happy bunch you are. You must be what 14 years old? I can't get over how many open source blind persons there are out there, if it isn't free it is shit.. what a sad sad attitude. This girl that says its 'hard' to install, why don't you go do your nails or something. If you have any amount of intelligence and bother to read the install manual it is not 'hard as shit' to install, and is a very robust installer, but I assume a kid like you wouldn't need the features it offers for your 2 node network. Why is the field being over ran by lamers like this? At this rate NIX admins will be no better than NT admins in another 5 years. so sad. We should have an age requirment to use/admin *NIX boxes.

#

Re:IREX

Posted by: Anonymous Coward on April 25, 2002 10:03 AM
well actually if you have to support the junk SGI claims is an operating system, you wind up calling it I-Wrecks ... cuz its a piece of dog shit to install, and maintain, and a huge nightmare to secure. get them SGI's behind a firewall if you can they're still the most haxored unix variant out there

#

True Innovation

Posted by: Anonymous Coward on April 25, 2002 08:01 AM
There you go Billy boy. This just proves how wrong you are about Open Source not fostering innovation.

This is only a win - win - win situation the way I see it. DreamWorks wins by leveraging off tools currently available, Open Source wins via further development being fed back into the community, and the whole world wins by a movie being produced cost effectively and Maya being ported to another platform so that other studios can continue the innovation.

This is exactly the way business should work in the future. Get rid of the M$ like greed factor and that is exactly what you have - true innovation that benefits everyone.

#

Re:True Innovation

Posted by: Anonymous Coward on April 25, 2002 09:21 AM
Well put... I couldn't agree more!

#

Great news but...

Posted by: Anonymous Coward on April 25, 2002 08:47 PM
...will the DVD release still be in a format that prevents the legal use of free software to play it?

If they only give one thing back to the community, let it be an unencrypted DVD. Only legitimate users suffer from that awful scheme.

#

They are paying us back...

Posted by: MARJanssen on May 04, 2002 04:42 PM
...by promoting the CBDTPA, which will mandate all new computers to carry proprietary digital rights management software using a "security system standards" sanctioned by the government.
This system will prohibit the playing of all "content" which isn't "watermarked" and created by an authorized party (ie: one of the big studio's).

It will be a federal felony punishable by 10 years jail (more than rapists get) to break this system (even for playing your old DV home movies), to play protected software on an old computer and to connect an old computer to the internet.

This bill is going to be a boon for Hollywood, who can stop worrying about piracy and sell more stuff (because all your old DVD's are going to be worthless), for the music industry (for the same reasons), for the tech industry (a ban on current technology will mean more sales because people want to keep up with the latest and greatest) and for Microsoft (who will see Linux dissappear and hopefully edge it's way in to provide the "security system standards" required by this bill and therefore become masters of the key to digital content forever).

In fact this bill will benefit everybody, except the consumer and the techies.

So you'll see it passed quicker than the DMCA was passed.

http://www.stoppoliceware.org

#

Re:Great news but...

Posted by: Anonymous Coward on May 09, 2002 10:20 AM
How else are they going to protect their work???
Watching a DVD on a computer is a waste of DVD, you may as well rent the VHS OR get a DVD player.
Its like buying a porche without the leather seats option

#

Hey

Posted by: Anonymous Coward on April 25, 2002 09:09 PM
But they forgot the most important thing of all! Are they using KDE or GNOME..?

#

Re:Hey

Posted by: Anonymous Coward on April 25, 2002 09:48 PM
A similar story to the one above apeared in Linux Journal a few months ago, from the screenshots shown they were using KDE, not sure if it was 1.x or 2.x.

#

Re:Hey

Posted by: Anonymous Coward on May 30, 2002 03:25 AM
Actually I work for Dreamworks, and they used GNOME on the animation machines but the Artists use KDE

#

This story has been archived. Comments can no longer be posted.



 
Tableless layout Validate XHTML 1.0 Strict Validate CSS Powered by Xaraya