July 23, 2007

open source portals

Manageability maintains a list of open source portals written in Java. I'm looking for a similar list for
  • Ruby that extends beyond Ruby on Rails
  • Adobe's platform

July 21, 2007

Web Trends 2007 v 2.0

Japan's Information Architects has published a subway-style map of the 200 most successful websites on the web, ordered by category, proximity, success, popularity and perspective.

The map is dense; it requires attention; it is likely to be useful to anyone who is "...exploring, defining and explaining the Internet strategy and positioning."

Its worthwhile to examine the IA home page as well as the map since the homepage includes, discussion, feedback, etc.

July 11, 2007

Nutch

Nutch is an open source Java implementation of a search engine. It provides all of the tools you need to run your own search engine. But why would anyone want to run their own search engine? After all, there's always Google. There are at least three reasons.

  1. Transparency. Nutch is open source, so anyone can see how the ranking algorithms work. With commercial search engines, the precise details of the algorithms are secret so you can never know why a particular search result is ranked as it is. Furthermore, some search engines allow rankings to be based on payments, rather than on the relevance of the site's contents. Nutch is a good fit for academic and government organizations, where the perception of fairness of rankings may be more important.
  2. Understanding. We don't have the source code to Google, so Nutch is probably the best we have. It's interesting to see how a large search engine works. Nutch has been built using ideas from academia and industry: for instance, core parts of Nutch are currently being re-implemented to use the Map Reduce distributed processing model, which emerged from Google Labs last year. And Nutch is attractive for researchers who want to try out new search algorithms, since it is so easy to extend.
  3. Extensibility. Don't like the way other search engines display their results? Write your own search engine--using Nutch! Nutch is very flexible: it can be customized and incorporated into your application. For developers, Nutch is a great platform for adding search to heterogeneous collections of information, and being able to customize the search interface, or extend the out-of-the-box functionality through the plugin mechanism. For example, you can integrate it into your site to add a search capability.

Nutch installations typically operate at one of three scales: local filesystem, intranet, or whole web. All three have different characteristics. For instance, crawling a local filesystem is reliable compared to the other two, since network errors don't occur and caching copies of the page content is unnecessary (and actually a waste of disk space). Whole-web crawling lies at the other extreme. Crawling billions of pages creates a whole host of engineering problems to be solved: which pages do we start with? How do we partition the work between a set of crawlers? How often do we re-crawl? How do we cope with broken links, unresponsive sites, and unintelligible or duplicate content? There is another set of challenges to solve to deliver scalable search--how do we cope with hundreds of concurrent queries on such a large dataset? Building a whole-web search engine is a major investment. In " Building Nutch: Open Source Search," authors Mike Cafarella and Doug Cutting (the prime movers behind Nutch) conclude that:

... a complete system might cost anywhere between $800 per month for two-search-per-second performance over 100 million pages, to $30,000 per month for 50-page-per-second performance over 1 billion pages.

This series of two articles shows you how to use Nutch at the more modest intranet scale (note that you may see this term being used to cover sites that are actually on the public internet--the point is the size of the crawl being undertaken, which ranges from a single site to tens, or possibly hundreds, of sites). This first article concentrates on crawling: the architecture of the Nutch crawler, how to run a crawl, and understanding what it generates. The second looks at searching, and shows you how to run the Nutch search application, ways to customize it, and considerations for running a real-world system.


--thanks to java.net & Tom White for the summary

December 11, 2006

Safari :: to the rescue

Yesterday I subscribed to Oreilly's Safari Bookshelf. Today I used it for the first time & I'm already happy. I just happened to notice that David Progue's "Missing Manual..." series has a volume on switching to the mac.
I can't tell if I'm getting the smallest ibook, the big power mac or something in between, but I'm finally, after 22 or so years, making the switch.
Enough of that, the point is because I have Safari, checking out the book is simple with no marginal cost.
Plus, I'm saving a tree.

November 18, 2006

system76

thanks to O'Reilly Radar I know where to get hardware...System76, dedicated linux.

November 09, 2006

ajax support in eclipse

The Ajax Tools Framework (ATF) is improving Ajax support in eclipse.

October 30, 2006

October 20, 2006

Scripting Java :: JavaScript

Interaction between the JVM based object system and another object system has many possible uses. For example
  • end users in many industries are already familiar with JavaScript and can use it to extend behavior of Java objects w/o learning Java, the constraints of Java, etc.
  • Java developers may use it for exploratory programming
  • Ajax is a special case
  • WebMonkey at eclipse appears to be stalled, but its intent was to allow much faster development of user interfaces in eclipse by going from JavaScript to to the RCP plugins
  • An entire JavaScript development environment has been built using this idea.
  • BIRT, a reporting framework for eclipse, provides java/javascript integration.
Rhino
EclipseMonkey
Aptana
BIRT




.

September 18, 2006

Java, Groovy, and (J) Ruby

So, you want to learn few scripting and dynamically typed language(s) for the Java platform? The following will get a Java programmer started with Groovy and (J)Ruby. It is said that you can write Fortran in any language! While you still have to learn language specific idioms, naming, coding conventions/styles etc., the table below would help you with "quick start". To re-iterate: you need to pick up language specific idioms as Reg Braithwaite notes in his comment below.

I wrote simple script samples and tried the same with command line wrappers of jrunscript. If you CVS checked out script engines from scripting.dev.java.net, these scripts are in bin directories of respective script engine directories. I used Groovy 1.0 JSR 06 and JRuby 0.9.0 versions respectively.

A. Sundararajan's Weblog

NetBeans is paying a lot more attention to dynamic languages than eclipse foundation

August 05, 2006

eclipse plugin hangups

Nothing serious. A couple nits and some weirdness. Pretty much all user error.
  1. I had a devil of a time getting access to some classes (CoreException) that should not have been a problem. Problem cleared up when I deleted the trailing empty line of .classpath. Help!
  2. Used Clayberg/Rubel to get some easy testing of a View. Cool. Remember to make sure the View is visable (probably a new accessor) from the source code and from the plugin manifest. Clearly that should be easy to remember.
Clayberg and Rubel deserve a metal.

July 31, 2006

How to set up Eclipse

How to set up Eclipse
Interesting page layout and concept. Really it covers ant, apache, svn, and junit as a package before installing eclipse.

I have not attempted to follow it, but the concept alone is valuable. The page is divided into three columns:
--summary & download
--installation tips
--background
Very cool.

July 30, 2006

So Big and Healthy Grandpa Wouldn’t Even Know You - New York Times

So Big and Healthy Grandpa Wouldn’t Even Know You - New York Times: "By GINA KOLATA

Valentin Keller enlisted in an all-German unit of the Union Army in Hamilton, Ohio, in 1862. He was 26, a small, slender man, 5 feet 4 inches tall, who had just become a naturalized citizen. He listed his occupation as tailor.

A year later, Keller was honorably discharged, sick and broken. He had a lung ailment and was so crippled from arthritis in his hips that he could barely walk.

His pension record tells of his suffering. “His rheumatism is so that he is unable to walk without the aid of crutches and then only with great pain,” it says. His lungs and his joints never got better, and Keller never worked again.

He died at age 41 of “dropsy,” which probably meant that he had congestive heart failure, a condition not associated with his time in the Army. His 39-year-old wife, Otilia, died a month before him of what her death certificate said was “exhaustion.”

People of Valentin Keller’s era, like those before and after them, expected to develop chronic diseases by their 40’s or 50’s. Keller’s descendants had lung problems, they had heart problems, they had liver problems. They died in their 50’s or 60’s.

Now, though, life has changed. The family’s baby boomers are reaching middle age and beyond and are doing fine.

“I feel good,” says Keller’s great-great-great-grandson Craig Keller. At 45, Mr. Keller says he has no health problems, nor does his 45-year-old wife, Sandy.

"
Full of amazing information -- especially that on the civil war generation and the 1918 influenza survivors.

'Sitefinder' Mobile Phone Base Station Database

'Sitefinder' Mobile Phone Base Station Database
Do we have anything like this in the US?

July 29, 2006

MIT researchers watch brain in action - MIT News Office

MIT researchers watch brain in action - MIT News Office:
"...an unprecedented look into how genes shape the brain in response to the environment. Their work is reported in the July 28 issue of Cell.

'This work represents a technological breakthrough,' said first author Kuan Hong Wang, a research scientist at the Picower Institute who will launch his own laboratory at the National Institute of Mental Health in the fall. 'This is the first study that demonstrates the ability to directly visualize the molecular activity of individual neurons in the brain of live animals at a single-cell resolution, and to observe the changes in the activity in the same neurons in response to the changes of the environment on a daily basis for a week.'"

Gianni Milanesi’s Weblog � AjaxWp - An AJAX enhancement for WordPress blogs

Gianni Milanesi’s Weblog � AjaxWp - An AJAX enhancement for WordPress blogs: "AjaxWp is a lightweight JavaScript enhancement that adds AJAX functionality to WordPress blogs speeding up load times, increasing the responsiveness of the user interface and giving the blog an overall cooler look.

Out of the box AjaxWp requires minimal configuration and no additional markup, other than the script inclusions in the header file and a support PHP file. This allows AjaxWp to degrade gracefully and leave the blog fully functional even for users with JavaScript disabled."

MagicDraw 11.5 Delivers UML 2 EMF Model ...

MagicDraw 11.5 Delivers UML 2 EMF Model ...: "Addressing the customers' need to use UML 2 models in major MDA tools or the exchange with other modeling tools based on Eclipse, MagicDraw 11.5 adds the export of its model to EMF based UML 2 XMI. It allows interchange of UML 2 models with most popular MDA tools such as AndroMDA, OpenArchitectureWare, Mia-Generation, Mia-Transformations and others for further manipulation and transformation. With the new version, No Magic continues to support its commitment of MagicDraw being the modeling tool of choice in the world of Model Driven Architecture. "

July 18, 2006

Google Web Toolkit get GUI / RPC IDE

Thanks to Ed Burnett, we know it will be out tomorrow.
Evidently it integrates with the eclipse Web Tools as well. Looks like it hides most of the nasty stuff and allows one to work at an object level w/o worrying about distribution, etc.

July 15, 2006

JS-Sorcerer 2.0 Released

I saw an early version at OOPSLA 2005
JS-Sorcerer™ helps you create interactive applications by quickly locating JavaScript problems and translating your standard programs to run in all popular browsers.

JS-Sorcerer can be used as a plugin to the Eclipse IDE or via a command-line interface.

Wonder how/if it works with GWT.