Showing posts with label lists. Show all posts
Showing posts with label lists. Show all posts

Tuesday, July 20, 2010

SharePoint Workspace 2010 “exceeds the lookup column threshold”

While trying to sync to a SharePoint site using SharePoint Workspace 2010, you may bump into the following strange error: "The query cannot be completed because the number of lookup columns it contains exceeds the lookup column threshold"

This is due to SharePoint’s new resource throttling settings for managing large lists. There is an easy fix in Central Administration.

Go to Central Administration and then browse to Application Management > Manage Web Application.  Select the web application you need.

In General Settings choose Resource Throttling. Set the value in the List View Lookup Threshold textbox to a higher value (equal to or greater than the number of site columns you are using on the list where you saw the error).

I bumped into this with Workspace but this error may appear for other client applications / systems that use SharePoint 2010 as a platform, and are trying to lookup lists that have more site columns than the throttle setting.

Wednesday, September 17, 2008

No More Metadata Migraines: Easily Manage Your Centralized Taxonomy

Well, I just finished my preso, which seemed to go very well (luckily!).

Basically my session covered best practices for taxonomy in SharePoint, including things you need to do (or not do) to make your lives easier when managing your portal's content.

It also covered ways you can leverage your metadata using Content Query Web Parts, property searches, and advanced searches.

Mindsharp will probably be making the presentation available on their SharePoint Best Practices website shortly. In the meantime I've uploaded the presentation in PDF format here: 

http://www.echotechnology.com/Events/Documents/No%20More%20Metadata%20Migraines%20-%20echoTechnology%20-%20SharePoint%20Best%20Practices%20Conference.pdf

As always I'd love to hear back from you about what your best practices are. My email's in the PDF, you can contact me via LinkedIn (http://www.linkedin.com/in/nicholaskellett) or you can comment on the blog.

The conference is over today, and we've really enjoyed it. We had lots of great conversations in seminar rooms, around the lunch table, and around the bar. It was neat to meet so many people who are enthusiastic about SharePoint, trying to do the right things with it, and willing to share their knowledge. I'll be blogging a bit more in the next few days, to try to transmit what I've learned.

Finally, congratulations to Mark Elgersma, Ben Curry, Bill English, and all the other Mindsharp folks who worked so hard to pull this off!

Thursday, March 20, 2008

Colligo: SharePoint Unplugged

One of the bigger issues with SharePoint is how to make it available to offline or remote users, such as frequent business travellers. There are many vendors working in this space including iOra (now Infonic) and Syntergy, and tools such as Groove are also very useful for this kind of requirement.

One vendor I've heard good things about is Colligo. Colligo has a product that presents SharePoint sites in a seamless online/offline manner so users don't need retraining.

This morning I decided to download the Colligo Reader. It provides a one-way sync from a SharePoint site to a computer or laptop, and is free for non-commercial use. It works for Windows SharePoint Services 2.0 and 3.0 sites, for SharePoint Portal Server 2003, and for Microsoft Office SharePoint Server 2007.

Colligo requires a .NET framework client install on the destination computer, and uses the SharePoint web services so it will be fully supportive of any upgrades and does not require any additional components or installs on servers or any other kind of tinkering.

Downloading it required a quick and painless sign-up at Colligo's website, and then a small install process taking only 30 seconds. Following that I had to quickly activate the program over the internet and I was off and running.

The user interface is spartan and SharePoint-like: this is a good thing as such a tool should be simple and effective at displaying and managing the site content rather than tossing up lots of bells and whistles. The SharePoint look-and-feel is also a must as it makes the whole experience seamless to end users. Here's a screenshot of the basic interface.

 Basic View

To create a sync to a SharePoint site, I used a personal WSS 2.0 site I've had for a few years. In the top left-hand side of the screen I selected the "Site" dropdown and clicked "Download Site". This popped up a very simple box that asked for the URL and the security credentials.

In only a few seconds I was connected and presented with the names of all the SharePoint lists in the site. Next to each was a checkbox so I could choose to synchronize with them. Having selected them all, it began to download the contents:

Synchronization

Sync options include sync'ing a particular site, sync'ing multiple sites, and sync'ing everything. At the bottom of the screen is a "Sync Issues" panel that helps manage any items that failed.

Following the successful download, I was able to read all the content on my WSS 2 website. Each list showed the appropriate views and metadata columns. Filter and sorting were enabled to help manage the content display. On the left hand side the Quicklaunch menu items were all present and there was breadcrumb navigation at the top of each list.

One thing I didn't see (at least in the Reader version) was a search functionality. This would have been very useful. One of my main criticisms of Groove is that its lack of search makes it virtually impossible to find offline content once you have a lot of content and folders. Although Colligo Reader does a much better job at presenting and organizing content (due to its SharePoint nature) search is a must-have in any offline synchronization tool.

Security is applied to the site and list content according to the credentials used to access the site. At least in the Reader version this means no switching between various user accounts for different permissions. Frankly I doubt anyone using the Reader would want to do that - that tends to be an administrator / developer activity. For the purposes of such a tool it only makes sense to manage the content using one set of credentials so I don't regard this as a drawback.

You can download Colligo Reader at their website. http://www.colligo.com/products/sharepoint/reader_how_it_works.asp. In addition to the Reader, there is a two-way Contributor version that allows offline modification of SharePoint lists. This is obviously the real value-add for Colligo. According to their website, pricing for this varies depending on the flavour of Contributor you buy - there are versions that integrate with Outlook and others that work on  PocketPCs.

All in all I was favourably impressed with the Colligo Reader - it is simple and intuitive and functioned exactly as I expected, and I plan to use it in the future.

Monday, November 12, 2007

SharePoint Migration With MetaLogix

I recently had the chance to evaluate a number of SharePoint content and site migration tools. Past migrations I've done have been performed using the out-of-the-box content migration using the Pre-Upgrade scan, but I have an upcoming requirement to leave the existing SharePoint Portal Server 2003 site and content in place and migrate it slowly to the new MOSS 2007 server over time.

This required an evaluation of third-party site migration tools. One of the ones I looked at was the MetaLogix SharePoint Site Migration Manager. The evaluation license allows you to migrate 50% of the content for a few days, which is enough to run the software through its paces.

The Migration tool installs on a client desktop and this GUI handles 95% of the migration tasks. However if you want the migration process to do things like map the user accounts you'll also need to install a special service on the target server.

I liked MetaLogix Migration Manager's intuitive interface. After the installation it was easy for me to add a reference to both the test SPS 2003 portal and the test MOSS 2007 portal. This is done by typing in the URL and either using the default portal access account or manually specifying it.

The interface has three major views:

  1. The default "Explorer" view, which is a complete site hierarchy view of the sites you have added;
  2. "Browser" view, which renders whatever site node you have selected in the explorer view. It's a great way to quickly view the content of a site or list; and
  3. "Item" view, which shows you the content of lists and libraries.

Migrating content or sites between portals was as easy as right-clicking the source node, clicking "Copy", and right-clicking on the target site and clicking "Paste". A dialog box shows the progress and the result appears in the Log window at the bottom of the screen, which you can always refer to. There is verbose logging in a text file.

Paste Shared Documents List

Other nice features:

  • Batch mode, so that all actions can be scripted to run at scheduled times. The batch file is in XML format so it can be programmed and is human-readable.
  • Delta migration: You can choose to only migrate the changesets instead of all the content each time.
  • List copy: You can choose to append and concatenate multiple libraries or lists together which helps merge them in the new portal.
  • You can migrate versioning and security permissions
  • Replace Within Field: This is a quick string search that allows you to replace text in content you've migrated, such as URLs. In the future I'm told this will be an automatic step in the migration.
  • Mapping to site templates. You can explicitly map SharePoint 2003 site templates to the new MOSS templates (it will attempt to map them automatically by default). I noticed the mapping options seemed to include the Fantastic 40 site templates which was a nice touch.

The only issue I found with the product occurred when I tried to migrate the content on an SPS 2003 Area over to MOSS 2007. It brought all the content, web parts, lists, and libraries over with the exception of the Area Detail and Browse Area By web parts. However as those two web parts relate to the old SharePoint 2003 Area concept which no longer applies, I'm not too fussed. The MetaLogix staff were keen to help me investigate this, if I had been willing.

During the course of the trial I spoke to Julien Sellgren and Rasool Rayani at MetaLogix. They were helpful and responsive to my questions, giving me a walkthrough via a webcast and extending the evaluation period while I was testing area migration. Rasool also explained to me that they are releasing feature packs and updates on a 6-week basis so the product is evolving quickly.

You can learn more about MetaLogix and download the evaluation version at their website.

Thursday, July 05, 2007

Yesterday evening I saw a live demo of echoTechnology's echo for SharePoint 2007 product, which is a tool for handling SharePoint migration and management. The presentation was
given by CEO Garry Smith, Technical Director Sergio Otoya, and Technical Evangelist Stephen Cummins. The company is positioning echo as the tool that "allows administrators to
effectively manage and migrate onto the SharePoint 2007 platform". The demo was an hour long and was really impressive. Following that I spoke with Stephen to get a little more
information about how they feel the product can be used. I'll be publishing that within a few days.

Last night's demo gave a clear indication of echo's design philosophy, which is to make replication and change management as easy and granular as possible. This is important
because it's actually really hard to roll changes across different SharePoint versions, sites, and environments. I've mentioned before on this blog how complicated I find it to
properly manage the customizations that I make. Echo aims to solve that.

The two core concepts or "streams" that echo specializes in handling are migration and management. Migration might include migrating content from SharePoint 2003, Domino,
Exchange, or file shares. Management includes managing workflows, features, web parts, content types or site hierarchies. By creating discrete "tasks" for each of these, echo
gives you very granular control, allowing you to do one or more tasks handling simple or complicated scenarios.

The first part of the demo was a migration from SharePoint 2003 to SharePoint 2007. Out of the box SharePoint provides options such as in-place, gradual, and content migration.
The steps required to do these, and the pros and cons of each, are well documented elsewhere on the net so I won't go in to them here.

The way echo does it is to use a fresh install of SharePoint 2007 as a clean environment in which to push the 2003 migration. You first create a template site in MOSS 2007 (they
called it the "Blueprint site") which has all the webparts, lists, and views you would like to migrate your 2003 stuff to. Next, you select the 2003 sites you would like to
migrate. The lists of migration candidate sites get added to what looks like an Excel plugin - this allows you to save the list to Excel and give it to your business users so
they can make any changes they want pre-migration. This ensures that someone can clean up metadata, illegal characters, or make any other changes before you do the site
migration. You can run the job right away, or schedule it to run automatically at a later time. You can also save it to use for other batches. Once the batch ran, we saw how the
sites from 2003 were all copied over to the 2007 portal. A log gives complete details on each step of the migration.

After the run, the web parts and lists were migrated, but not any of their content. This led to the second demo, which was about content migration or "content loading" as it is
called. Having migrated the 2003 sites over, we were shown how the Content Loader Task allowed an administrator to map existing 2003 content, including its related metadata,
over to content types created on the 2007 portal. The mechanism to do this is very granular, so content settings, fields, views, permissions, version history and the like can
all be migrated across in whatever way you want.

There is even a choice to truncate the version histories, so that if you wanted you could migrate only the last couple of versions of content to the new 2007 portal. Once again
all of this can be saved to an Excel "control file", which allows customers to modify the migration settings if they want. This allows a deep level of control over the process,
and the Excel format is very user-friendly. In fact if I understood correctly formulas could even be run over the control files to do quick formatting.

The echo team say that one of the primary goals of the Content Loader Task is to help manage content types and support a central taxonomy. They feel that this is a key
requirement to really gain value from a MOSS portal with targeted searches. They have seen that many organizations don't bother doing this in a systematic way due to the adhoc
and unstructured way SharePoint 2003 allowed metadata columns to be added. Since an out-of-the-box migration will just try to copy existing metadata columns across without any
adjustments, and since the administrators doing the migration don't have any knowledge of what metadata should be placed on the content, the tendency is just to port all of
it over to the 2007 portal without applying any lessons learned or disciplined taxonomy. By using the Excel control file, the burden of applying appropriate metadata is removed
from the shoulders of the administrators handling the migration, and placed in the hands of content authors where it belongs. The Excel format seems like a logical way and
friendly to get content authors to plan and manage their metadata before a migration.

Having demonstrated the ease with which metadata can be changed in the Excel control file, it was reloaded into the echo interface, the batch was run, and all the content
migrated over to the 2007 sites and mapped to Content Types as planned.

The next demonstration was a quick example of loading content from file shares - in this case images kept in a series of folders. What was neat here was that there were four
folders with only two duplicated images in each - basically an example of versioning as it is usually done on a file system. The content loader provided a mechanism to
"collapse" these files together so that upon import, there were only two images but they each had the complete version history of their four versions taken from the folders.

At this point we were shown the concept of batching, which facilitates scheduling and change management for SharePoint. Any number of tasks could be added and configured,
providing complete flexibility for whatever scenario was required. The batches could be saved for future use, and scheduled to run at a particular time (such as after business hours). Batching is also an effective mechanism for migrating changes between environments.

Things I found noteworthy:
  • The Excel plugin approach is a very good idea. Garry suggested this was driven directly from customer feedback.
  • The granular level of tasks is useful because no-one is second-guessing how you want to do a migration or management - you are free to chain the tasks together in whichever
    order or process you like.
  • The ability to migrate workflows is pretty key as one of the drawbacks of using SharePoint Designer is that it links a workflow to a particular list - and echo would remove that
    problem.
I'm sure that some organizations will value this tool for the help it can give migrating from SharePoint 2003 to 2007, especially with more complicated sites. It may help such
organizations "jump the gap" if they are hesitating due to the complexity of managing the transition. I haven't had to do many upgrades and those have been straightforward
"content migrations" so this is less important to me. Personally I'm most interested in the potential it has for migrating SharePoint customizations from development to testing
to production. This is a requirement in any organization that supports SharePoint and very hard to address without such a tool, and it's an ongoing need.

Echo for SharePoint 2007 is scheduled for release at the end of July. If you're interested you can find out more information and download a trial at echoTechnology's website
(http://www.echotechnology.com/).

Sunday, April 08, 2007

Feature IDs and Template Numbers For Lists and Libraries

Again, by way of Mick Badran, a helpful tip for when you need to find the GUID or Template number for a list (because you are developing features, or using the SharePoint object model perhaps). You can find the template number and Feature ID for any list type by clicking "Create" and looking at the browser status bar at the bottom. For your convenience I have a list of the common lists and libraries and their Feature ID and Template number:

Libraries

  • Document Library
    • FeatureId={00bfea71-e717-4e80-aa17-d0c71b360101}
    • ListTemplate=101
  • Form Library
    • FeatureId={00bfea71-1e1d-4562-b56a-f05371bb0115}
    • ListTemplate=115
  • Wiki Page Library
    • FeatureId={00bfea71-c796-4402-9f2f-0eb9a6e71b18}
    • ListTemplate=119
  • Picture Library
    • FeatureId={00bfea71-52d4-45b3-b544-b1c71b620109}
    • ListTemplate=109
  • Report Library
    • FeatureId={2510d73f-7109-4ccc-8a1c-314894deeb3a}
    • ListTemplate=433
  • Translation Management Library
    • FeatureId={29d85c25-170c-4df9-a641-12db0b9d4130}
    • ListTemplate=1300
  • Data Connection Library
    • FeatureId={00bfea71-dbd7-4f72-b8cb-da7ac0440130}
    • ListTemplate=130
  • Slide Library
    • FeatureId={0be49fe9-9bc9-409d-abf9-702753bd878d}
    • ListTemplate=2100

Communications
  • Announcements
    • FeatureId={00bfea71-d1ce-42de-9c63-a44004ce0104}
    • ListTemplate=104
  • Contacts
    • FeatureId={00bfea71-7e6d-4186-9ba8-c047ac750105}
    • ListTemplate=105
  • Discussion Board
    • FeatureId={00bfea71-6a49-43fa-b535-d15c05500108}
    • ListTemplate=108
Tracking
  • Links
    • FeatureId={00bfea71-2062-426c-90bf-714c59600103}
    • ListTemplate=103
  • Calendar
    • FeatureId={00bfea71-ec85-4903-972d-ebe475780106}
    • ListTemplate=106
  • Tasks
    • FeatureId={00bfea71-a83e-497e-9ba0-7a5c597d0107}
    • ListTemplate=107
  • Project Tasks
    • FeatureId={00bfea71-513d-4ca0-96c2-6a47775c0119}
    • ListTemplate=150
  • Issue Tracking
    • FeatureId={00bfea71-5932-4f9c-ad71-1557e5751100}
    • ListTemplate=1100
  • Survey
    • FeatureId={00bfea71-eb8a-40b1-80c7-506be7590102}
    • ListTemplate=102
Custom Lists
  • Tabs List - ?
  • Custom List
    • FeatureId={00bfea71-de22-43b2-a848-c05709900100}
    • ListTemplate=100
  • Custom List in Datasheet View
    • FeatureId={00bfea71-3a1d-41d3-a0ee-651d11570120}
    • ListTemplate=120
  • Languages and Translators
    • FeatureId={29d85c25-170c-4df9-a641-12db0b9d4130}
    • ListTemplate=1301
  • KPI List
    • FeatureId={065c78be-5231-477e-a972-14177cc5b3c7}
    • ListTemplate=432
  • Import Spreadsheet - N/A

Web Pages - N/A