Home Blog Page 594

Tying Together the Many Open Source Projects in Networking

The Open Platform for Network Functions Virtualization (OPNFV) is driven more by iterative code releases than by heavyweight up-front standardization efforts.

There are a lot of pieces to the ongoing network transformation going up and down the stack. There’s the shift away from proprietary hardware. There’s the to need to manage complex network configurations. Add subscriber management and a wide range of other necessary functions. Add customer-facing services. All of those pieces need to fit together, integrate with each other, and interoperate.

This was the topic of my conversation with Heather Kirksey, who heads up the Open Platform for Network Functions Virtualization (OPNFV) project when we caught up at the Open Source Leadership Summit in mid-February. 

Read more at OpenSource.com

Container-Friendly Alpine Linux May Get Java Port

Alpine Linux, a security-focused lightweight distribution of the platform, may get its own Java port. Alpine is popular with the Docker container developers, so a Java port could pave the way to making Java containers very small.

A proposal floated this week on an OpenJDK mailing list calls for porting the JDK (Java Development Kit), including the Java Runtime Environment, Java compiler and APIs, to both the distribution and the musl C standard library, which is supported by Alpine Linux. 

Read more at InfoWorld

30 Examples For Awk Command In Text Processing

On the previous post we’ve talked about sed Linux command and we’ve seen many examples of using it in text processing and how it is good in this, nobody can deny that sed is very handy tool but it has some limitations, sometimes you need a more advanced tool for manipulating data, one that provides a more programming-like environment giving you more control to modify data in a file more robust. This is where awk command comes in.

The awk command or GNU awk specifically because there are many extensions for awk out there takes stream editing one step further than the sed editor by providing a programming language instead of just editor commands. Within the awk programming language, you can do the following

  • Define variables to store data.
  • Use arithmetic and string operators to operate on data.
  • Use structured programming concepts and control flow, such as if-then statements and loops, to add logic to your text processing.
  • Generate formatted reports

Actually generating formatted reports comes very handy when working with log files contain hundreds or maybe millions of lines and output a readable report that you can benefit from.

our main points are:

command options

Reading the program script from the command line

Using data field variables

Using multiple commands

Reading the program from a file

Running scripts before processing data

Running scripts after processing data

Built-in variables

Data variables

User defined variables

Structured Commands

Formatted Printing

Built-In Functions

User Defined Functions

https://likegeeks.com/awk-command/

Hope you like it

Thank you

 

“I Am A Mainframer” Interview Series: IBM

In our second conversation of our “I Am A Mainframer” interview series, Jeffrey Frey talks with Emily K. HugenbruchOpenStack Cloud Enablement Engineer, z/VM and Software Engineer at IBM about the OpenStack Newton release and her overall career experience as a woman working in the mainframe space. 

 The conversation is sponsored by the Open Mainframe Project. As a Linux Foundation Project, the Open Mainframe Project is intended to help create a mainframe focus, open-source technical community and to serve as a focal point for the development and use for enterprise Linux and a Mainframe computing environment.

 The goal of the project is to excite the Linux community around the use of the mainframe and to foster collaboration across mainframe community and develop and exploit shared Linux tool sets, resources, and services within the mainframe environment. In addition, the project seeks to involve the participation of academic institutions to help assist in creating educational programs aimed at developing the mainframe Linux engineers and developers of tomorrow. …

Jeffrey: Emily what do you think the biggest challenges are for the mainframe going forward. We’ve talked a lot about, you know, what we’re doing here to enable the platform. What do you see as the challenges in front of you?

Emily: I think one of our biggest challenges is really talking about what cloud means, and especially now that we’re getting into container technologies, how a lot of times those container technologies and how they interact with projects like OpenStack are still not very well defined yet. So when you add the in the extra layer of Z systems then that’s an extra challenge of how should these things interact? What do we need to do to make sure that our customers are happy with them, that they like how these things fit together and that it’s easy to put together.

There are a lot of things that you can do if you play around and really hack it but when we’re talking about the mainframe, our customers want something that’s very reliable, very easy, straightforward to put together and very well thought out and backed up by IBM so yeah, there’s a tremendous amount of work to be done with defining that interaction.

Read more at Open Mainframe Project

Takeaways from the Open Source Leadership Summit: Mainstream Open Source, Security, Policy, and Business Models

By Melissa Smolensky

The 2017 Open Source Leadership Summit, put on by the Linux Foundation, brought together leaders from the open source community in Lake Tahoe last week to discuss timely open source topics. The topics that came up most throughout the conference included: open source becoming mainstream, future open source business models, security in a time where everything is connected, and a call to action to be active in technology policy.

Open source is becoming a larger focus for major companies, from Toyota to Disney to Walmart. While open source vendors continue to look to the Red Hat model as one of the most successful open source business models to date, entrepreneurs believe there are new models that can surpass this success. As the world becomes ever more connected to the internet, there are general concerns about security, and a call to take action in policymaking. Read on below to learn more about the conversations at the Open Source Leadership Summit.

Open source is mainstream

The number of companies involved in open source projects is growing, and the community includes familiar company names from auto companies, to banking, to healthcare. Open source is not only being adopted by companies of every industry; these companies are also contributing to the projects themselves.

In his opening keynote, Jim Zemlin, executive director of the Linux Foundation, stated that 99.4% of the world’s high performance computing systems run Linux, 64.8% of mobile devices run Linux, and 90% of the stock exchange runs on Linux.

Jim Zemlin giving his keynote at the Open Source Leadership Summit 2017

Jim Zemlin giving his keynote at the Open Source Leadership Summit 2017.

Companies such as Toyota, Daimler (DaimlerChrysler), American Express and J.P. Morgan are just some of the companies actively involved with open source standards, including with the Linux Foundation’s work with Blockchain (for the financial industry) and Automotive Grade Linux. Walmart, Capital One and Disney each spoke about their internal open source programs to not only use open source internally, but to contribute to open source as well.

As enterprises adopt open source technologies, many are looking to work alongside a vendor for support. In his keynote, Al Gillen, Vice President, Software Development and Open Source at IDC, shared research about how companies decide to adopt open source software. His report showed that 45% of enterprise companies ranked working with a commercial vendor as a top priority when adopting open source.

Al Gillen presents at the Open Source Leadership Summit 2017.

Al Gillen presents at the Open Source Leadership Summit 2017.

Security is internet security

Now that our physical space is connected to the internet through the Internet of Things movement, overall security is internet security. Bruce Schneier gave a keynote talking about how those working on the internet are building one large robot that affects the virtual world as well as the physical world.

Schneier cited a Gartner estimate that 5.5 million new end-user devices connect to the internet every day. While devices such as iPhones and Android phones are automatically patched with software and security updates, there are many more devices released each month that do not have security built-in automatically. This is a big problem in a time where hackers are using Internet of Things devices to create botnets to attack and bring down the internet.

CoreOS is a company founded with the mission to secure the internet and that provides software and security patches through self-driving infrastructure. Bruce’s discussion about the growing security challenges of the always-connected age resonates with our mission. CoreOS is a key part of the future to secure the backend of the internet, but like Bruce brought to light, there is more work to be done on the Internet of Things side as well.

Government Policy for the Internet Age

Bruce also begins a call to action for the open source community to take part in crafting policy. The government will write and enforce policy for technology companies on security and privacy, whether we participate or not. He posed the question about how open source will continue to thrive in a time of increasing government regulation, which is why the open source community must be actively involved in conversations about policy. He asks the open source community to take a seat at the table and have a voice in government policy making, rather than being handed policy from the government and reacting after the decisions have been made.

Additionally, William Hurley (also known as Whurley, discussed how the open source community is ideally situated to be involved in civic-minded activities. From bio-hacking to architecture to education to government – the open source community has the capabilities to help our government have the right responses to technology innovation. He left the stage asking the community to get involved so we can help shape the way the world interacts with technology.

The evolving open source business model

In breakout talks, Craig McLuckieSarah Novotony and Stephen Walli discussed the future business model for open source companies. No one had the definitive answer to the most successful open source business model of the future – while the open core model with support and services is well received, many think the open source model is ready for disruption. We’re seeing innovative approaches to open source market and we’re looking forward to seeing how they turn out.

Stephen Walli’s presentation underlined the need for vendors to focus on solving customer problems. Stephen’s advice is: those that focus on the customer will have the most successful open source model in the end.

What’s next?

We enjoyed the conversation with the thought leaders at the Open Source Leadership Summit and want to continue these conversations on how we can work together to broaden the open source community, explore new open source business models, strengthen security in an increasingly interconnected world, and become more active participants in creating technology policy.

Continue the conversation at CoreOS Fest on building, running, and securing your infrastructure, May 31-June 1.

This article originally appeared on CoreOS (republished with permission).

Persistent Memory Usage within Linux Environment by Maciej Maciejewski & Krzysztof Czurylo, Intel

Intel engineer Maciej Maciejewski examines the primary differences between persistent memory, storage devices, and regular DRAM.

This Week in Open Source News: Diversity Talk at OSLS Reveals Minority Challenges in Tech, ONAP Project Announced & More

This week in open source and Linux news, a talk on diversity in tech sparked a pithy article for The New Stack via Darryl Taft, The Linux Foundation consolidates two projects to form ONAP, and more. Keep reading for a curated look at the top OSS headlines of this past week. 

1) “Diversity in Open Source” talk at Open Source Leadership Summit tackled the challenges women and minorities still face in the tech industry. Darryl Taft comments. 

Amidst Bias, Women Work to Find a Place in Open Source Communities– The New Stack

2) The Linux Foundation seeks to consolidate two of its open source orchestration and management efforts.

Linux Foundation Creates New Platform for Network Automation– WSJ

3) “Google fuzzer helps find 11-year-old memory-corruption flaw in the Linux kernel.” Linux’s Decade-Old Flaw: Major Distros Move to Patch Serious Kernel Bug– ZDNet

4) “Xen Project helps to advance the state of MirageOS unikernel operating system with a new release that now supports the KVM hypervisor.”

MirageOS Unikernel Effort Moves Forward– eWeek

5) Valve releases SteamVR for Linux, letting developers “create Linux content for the HTC Vive VR headset, trackers and other hardware.”

Valve Launches SteamVR Support for Linux– Engadget

How to Install Apache Directory Studio and Connect to an OpenLDAP Server

If you happen to administer one or more OpenLDAP servers, you know that they can be a challenge to work with. Working with LDAP itself can be a bit tricky; to that end, many opt to go the phpLDAPadmin route (which is an amazing tool for individual servers). However, when you’re managing numerous LDAP servers, you don’t want to have to log in and out of various instances of that tool. If that’s the case, what do you do? There’s one particular piece of software that does an outstanding job of managing multiple LDAP servers: Apache Directory Studio.
Apache Directory Studio is part of the Apache Directory project that strives to increase LDAP awareness, comfort and adoption to bring forth what we call the Modern LDAP Renaissance. The project includes:

  • Apache Directory Server — an extensible and embeddable directory server

  • Apache LDAP API — an enhanced LDAP API

  • Apache Mavibot — a Multi Version Concurrency Control (MVCC) BTree

  • Apache Kerby — a Java Kerberos binding

  • Apache Fortress — a standards-based Access Management System

And, of course, the Apache Directory Studio, which is a tool intended to be used with any LDAP platform.
I am going to walk you through the process of installing Apache Directory Studio as well as how to connect it to a working LDAP instance. I will demonstrating how to connect Apache Directory Studio to an OpenLDAP server on a separate virtual machine. I will assume you already have your OpenLDAP server up and running.

Installing Apache Directory Studio

I will be demonstrating the installation of Apache Directory Studio on an instance of Ubuntu Linux 16.04. If you are using a different distribution, you will have to adjust accordingly.

The first thing you must know is that Apache Directory Studio is a graphical application written in Java. To that end, you must first install the Java JDK8. To do this, follow these steps:

  1. Open up a terminal window

  2. Add the necessary repository with the command sudo add-apt-repository ppa:webupd8team/java

  3. Update apt with the command sudo apt update

  4. Install Java by issuing the command sudo apt install oracle-java8-installer

  5. Accept the license agreement

  6. Set the Java environment variables with the command sudo apt install oracle-java8-set-default

That’s it. You can now test to ensure Java is installed with the command javac -version (Figure 1).

Figure 1: Testing to make sure Java has been installed.

Now you can move on to downloading and running the Apache Directory Studio. There is no actual installation from this point on. Instead, you download the file, unpack it, and run the executable. Because there is no installation process, you will want to save the file in a location that is convenient and offers your user read/write/execution privileges. Here are the steps:

  1. Download the Apache Directory Studio tar file from the official Apache site

  2. Save the file to the chosen location

  3. Open a terminal window

  4. Change into the chosen directory

  5. Unpack the downloaded file with the command tar xvzf ApacheDirectoryStudio-XXX.yyy.tar.gz (where XXX is the release number and yyy is either 32 or 64 bit)

  6. Change into the newly created ApacheDirectoryStudio directory with the command cd ApacheDirectoryStudio

  7. Start the software with the command ./ApacheDirectoryStudio

At this point, you should now see the Apache Directory Studio main window (Figure 2).

Figure 2: The Apache Directory Studio main window ready to work.

Connecting to an LDAP server

You are now ready to connect Apache Directory Studio to your LDAP server. Click File > New and then select LDAP Connection (Figure 3).

Figure 3: Starting the LDAP Connection wizard.

In the next window (Figure 4), you must enter the information for your LDAP server. Give it a name, enter the hostname (or IP address), port number, select the encryption method, and the provider. Once you’ve filled out that information, click Check Network Parameter to make sure everything is working properly.

Figure 4: Setting up your LDAP configuration.

Click Next and you will then be required to fill out the authentication information for your connection (Figure 5). Select the Authentication Method, Bind DN or user, Bind password, and then click Check Authentication.

Figure 5: Filling out the authentication requirements for your LDAP server.

If your LDAP server requires SASL or Kerberos to be configured, expand those options and fill them out. Once you’ve completed this window, click Next.

In the next window (Figure 6), you can specify additional parameters for browsing your LDAP directory. As with many of the other options, these will depend upon your needs and how your LDAP server was configured.

Figure 6: Additional options for your LDAP connection.

Finally you can specific parameters for editing entries on your LDAP server (Figure 7). Again, this will be determined by your needs and how you’ve setup your LDAP server.

Figure 7: The final window of the connection wizard.

When the LDAP Browser window opens (Figure 8), you can then click on your dc entry and start working with LDAP.

Figure 8: A successful LDAP connection.

To work with LDAP, you will right-click on the right pane and select the option you want to use (such as creating a new Attribute — Figure 9).

Figure 9: Creating a new Attribute in Apache Directory Studio.

Expand the dc= entry (in the left pane) and you can then start adding Users and Groups. Click on Users and then right-click ou=Users, select New, and you can then create from a long list of available object classes (Figure 10).

Figure 10: Creating a new object with Apache Directory Studio.

There you have it. You’ve successfully, installed, connected, and used the Apache Directory Studio to work with your existing LDAP server. You can now connect Apache Directory Studio to any of your LDAP servers and manage them all from a single point of entry.

For more information on using the Apache Directory Studio, take a look at the official user documentation.

Learn more about Linux through the free “Introduction to Linux” course from The Linux Foundation and edX.

Persistent Memory Usage in Linux

In most cases, when a machine crashes or fails, we lose whatever we had loaded into memory, which for some applications can result in quite a bit of time and effort to recover when the system comes back online. At LinuxCon Europe, Maciej Maciejewski, Senior Software Engineer at Intel, talked about how persistent memory can be used to retain its contents after a power failure.

Maciejewski started by talking about how this works from a hardware perspective, since the hardware to do this has been around for some time. The idea is that you can take a dual in-line memory module (DIMM), which normally holds DRAM memory. These DRAM-like chips can also retain data across power cycles, so if your machine goes out, crashes, whatever happens, you take this non-volatile DIMM out, and it contains all of your data. It doesn’t lose anything. At Intel, they are currently working on a product that will be able to get up to three terabytes of non-volatile memory.

The hardware is evolving, but it’s only part of the solution. Maciejewski explained how the software needs be easy to use if the product is going to be successful. A couple of years ago, the Storage Networking Industry Association (SNIA) formed a working group around non volatile programming, which came up with a standardized programming model that forms the base of the NVM Library that Maciejewski discussed. The NVM Library is actually a collection of libraries that can be used to develop software to take advantage of persistent memory. 

  • libpmem – Basic persistency handling
  • libpmemblk – Block access to persistent memory
  • libpmemlog – Log file on persistent memory (append-mostly) 
  • libpmemobj – Transactional Object Store on persistent memory 
  • libpmempool – Pool management utilities
  • librpmem – Replication

One real-world example of an application that would benefit from persistent memory usage is an in-memory database, like Redis. Maciejewski mentioned that the obvious advantage is startup time. When you put all of the data into persistent memory and work with it directly, you aren’t working with a memory copy or loading from the disk into memory, so the start up is instant. With large datasets in the multiple terabyte range, going from hours to an instant is a big advantage.

Persistent memory usage is still a work in progress that will require time for adoption, but Maciejewski hopes that “this will revolutionize the computing that we have right now.”

To hear all the details and see the performance charts from the Redis example, watch the complete presentation below.

Interested in speaking at Open Source Summit North America on September 11 – 13? Submit your proposal by May 6, 2017. Submit now>>

Not interested in speaking but want to attend? Linux.com readers can register now with the discount code, LINUXRD5, for 5% off the all-access attendee registration price. Register now to save over $300!

Engineer Finds Passion and Community With Kids On Computers

If you love technology, you can find a space for yourself and connect with others around mutual interests, according to Avni Khatri, president of Kids on Computers (KoC), a nonprofit that sets up computer labs using donated hardware and open source software in areas where kids have no other access to technology.  

During LinuxCon North America 2016, Khatri organized Kids Day, a day-long workshop that’s aimed at helping school-aged children get interested in computer programming. For Khatri, it’s also a way of furthering her dream of giving children unlimited access to education and helping them succeed in technology.

“The key is to find what you are passionate about and work in that space,” she said. “For me, Kids on Computers is that place. The organization has transformed my thoughts on how much impact I can have in the world. It’s shown me that a little can go a long way (though there is a lot more to do!), and I always have it within me to give.”

“Find your community and connect with them on a regular basis,” advised Khatri.

Although Khatri has been working with the KoC project since 2010, in her day job, she is Program Manager of the Knowledge and Technologies Group in the Massachusetts General Hospital Laboratory of Computer Science. There she helps build bioinformatics applications using open source software and hardware.

“My interests include studying different learning methodologies and researching and implementing different technologies and modalities to deliver learning content, said Khatri in an interview.

Before working at MGH, she was a Front-End Engineer on the Flex Force Tiger Team at Yahoo! Inc. “Engineers on the team are deployed to work in 3-6 month cycles on the highest priority projects at Yahoo! I was also co-president of the Southern California chapter of Yahoo! Women in Tech,” she said.

Khatri, who has a BS in Computer Science from Cal Poly Pomona, has been working on computers for a very early age. “I learned to program in BASIC when I was 11 and started working building database-backed web sites when I was 19,” she said.  

She started contributing to open source while at Arsdigita back in 2000, where they developed a framework that allowed people to build community-based web sites easily and included standard packages that one would expect in groupware. The product eventually became OpenACS and Khatri was elected to the Technical Committee and became more involved. “I learned the value of FOSS and how it can help bridge and connect virtual and real-world communities,” she said.

Real world challenges for women in tech

Khatri thinks that one of the challenges women engineers in particular face is feeling alone. “Women engineers are in a significant minority on engineering teams and it can be hard to be the only woman on a team of 5 or 10 engineers,” she said.

Her dream is that everyone, especially kids, get unlimited access to education so that they can decide for themselves what their lives should be so they can improve their own lives and the lives of their communities. This aligns with the mission of KoC perfectly. “Because of my belief in the vision, I am able to focus on the organization and work my way through challenges that arise.”

When talking about inspiring and motivating others, Khatri advises: listen to them and be inclusive. Most of the time we don’t listen to learn, we listen to respond, but Khatri believes that “understanding people’s goals and seeing if you can help is one way to motivate and inspire them. I believe that everyone needs to find out what works for them and supporting people in their self-determined goals goes a long way towards retaining them as volunteers in a FOSS organization or anyplace.

Interested in attending Open Source Summit North America on September 11-13? Linux.com readers can register now with the discount code, LINUXRD5, for 5% off the all-access attendee registration price. Register now to save over $300!