Category Archives: Uncategorized

SharePoint 2013 Not Crawling Cold Fusion (CFM) Pages

It’s not every day that you find needle in a haystack, but when you do it’s worth blogging for prosperity…

My customer has set up SharePoint 2013 as the central search authority for their organization and uses it to crawl non-SharePoint sites as well as SharePoint. We noticed that SharePoint was not crawling links in Cold Fusion pages (.cfm). Instead, the crawler was treating CFM pages as text and stopping at the top-most levels without indexing lower-level pages.

We noticed in testing that renaming CFM to HTML extension fixed the issue, but wasn’t sustainable for the vast number of CF sites in the organization.

For the longest time I was messing around with the New-SPEnterpriseSearchFileFormat cmdlet, urging SharePoint to treat CFM pages the same as HTML. What I determined is this cmdlet is good for mapping custom extensions to Windows platform IFilters. What I wanted to do was to mimic the crawler indexing HTML pages, which does not use Windows IFilters. After much perseverance, I found the following information (included below, incase the link goes away):

# To check the current settings for filtering extensions, run the following command lines:
$ssa = Get-SPEnterpriseSearchServiceApplication "Search Service Application"
$ssa.GetProperty("ExtensionsToFilter")
# Here's the default output that you'll receive:
#;ascx;asp;aspx;htm;html;jhtml;jsp;mht;php;

#To add the .cfm extension to the property, run the following commands:
$ssa.SetProperty("ExtensionsToFilter", ";ascx;asp;aspx;htm;html;jhtml;jsp;mht;php;cfm;")
$ssa.Update()
# To restart the search functionality on a crawler when no crawling is occurring, run the following commands:
net stop osearch15
net start osearch15

https://support.microsoft.com/en-us/kb/2953907

SharePoint 2016 MinRole Services List

Hopefully, by now we should all know about MinRole functionality in SharePoint 2016. If not, check out Bill Baer’s article here. In setting up my new farm, I was curious as to what services should live on what server to be in compliance. Of course, the point of MinRole is to save farm architects from worrying too much about this, but I was curious.

The list at the bottom of this post lists of all SP2016 services and the associated MinRole. I cannot take credit for the list, I got help from a post, located here, and converted the C# code to PowerShell:

    $servicesInRole = @{};
    $minRoleValues = [System.Enum]::GetNames([Microsoft.SharePoint.Administration.SPServerRole]);
    $minRoleValues | % { $servicesInRole.Add($_, (New-Object System.Collections.ArrayList)); }

    $farm.Services | % {
        $service = $_;
        $service.Instances | % {
            $serviceInstance = $_;
            # Check in which minrole the service can reside.
            $minRoleValues | % {
                if ($serviceInstance.ShouldProvision($_)) {
                    [System.Collections.ArrayList]$item = $servicesInRole.Get_Item($_);
                    if (!$item.Contains($service.TypeName)) {
                        $item.Add($service.TypeName) | Out-Null;
                    }
                }
            }
        }

    }

Interestingly, the list includes a role called “SingleServer”, which is not the same as “SingleServerFarm”. I’ve not yet tried adding a new server to my farm with this “SingleServer” role. I imagine this is for specific purpose, since it includes the insights service, but not much else.

I’ve been reading some comments about MinRoles and there appears some confusion surrounding the purpose of a MinRole. Essentially, a MinRole is a default configuration for a SharePoint server in the farm, based on the role the server will play in real life. For example, the “WebFrontEnd” role consists of services optimized for front end content delivery, since users typically hit these servers directly (via load balancer). The “Application” role consists of services optimized for back end processing.

Notice that some services exist in multiple MinRole configurations. For example, the “WebFrontEnd” and “Application” roles both contain the Business Connectivity Services. It’s feasible that both end users and back end processes require access to BCS. Therefore the BCS service lives in both role configurations, likewise with the Secure Store Service etc. This might upset some minimalist architects who like to deploy all services to one (or many) application servers and just web application services to WFE servers. If you think about it, it’s probably better to deploy some services to WFE servers when these services deliver content to end users.   If you’re looking for fine grained control over deployment location of SharePoint services, use the “Custom” role.

Something I found out after adding a new WFE server to my farm, which had services preconfigured on my App server – SharePoint started services included in the “WebFrontEnd” MinRole on my WFE server automaticlly. As I should have expected.

MinRole: WebFrontEnd

Service: Access Services 2010
Service: Microsoft Project Server Events Service
Service: Secure Store Service
Service: Microsoft SharePoint Foundation Web Application
Service: Request Management
Service: SSP Job Control Service
Service: Project Server Application Service
Service: PerformancePoint Service
Service: Visio Graphics Service
Service: Managed Metadata Web Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft SharePoint Foundation Sandboxed Code Service
Service: Microsoft Project Server Calculation Service
Service: Microsoft SharePoint Foundation Tracing
Service: SharePoint Server Search
Service: Microsoft SharePoint Foundation Timer
Service: App Management Service
Service: Security Token Service
Service: Machine Translation Service
Service: Microsoft Project Server Queuing Service
Service: Microsoft SharePoint Foundation Usage
Service: Microsoft SharePoint Foundation Subscription Settings Service
Service: Claims to Windows Token Service
Service: User Profile Service
Service: Business Data Connectivity Service
Service: Access Services
Service: Microsoft SharePoint Insights
Service: Information Management Policy Configuration Service

MinRole: SingleServerFarm

Service: Access Services 2010
Service: Microsoft Project Server Events Service
Service: Secure Store Service
Service: PowerPoint Conversion Service
Service: Microsoft SharePoint Foundation Web Application
Service: Request Management
Service: SSP Job Control Service
Service: Project Server Application Service
Service: PerformancePoint Service
Service: Visio Graphics Service
Service: Managed Metadata Web Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft SharePoint Foundation Sandboxed Code Service
Service: Microsoft Project Server Calculation Service
Service: Microsoft SharePoint Foundation Tracing
Service: SharePoint Server Search
Service: Microsoft SharePoint Foundation Timer
Service: App Management Service
Service: Security Token Service
Service: Machine Translation Service
Service: Microsoft Project Server Queuing Service
Service: Application Discovery and Load Balancer Service
Service: Microsoft SharePoint Foundation Usage
Service: Microsoft SharePoint Foundation Subscription Settings Service
Service: Search Administration Web Service
Service: Word Automation Services
Service: Claims to Windows Token Service
Service: User Profile Service
Service: Business Data Connectivity Service
Service: Lotus Notes Connector
Service: Microsoft SharePoint Foundation Workflow Timer Service
Service: Access Services
Service: Microsoft SharePoint Insights
Service: Search Host Controller Service
Service: Information Management Policy Configuration Service
Service: Microsoft SharePoint Foundation Incoming E-Mail
Service: Search Query and Site Settings Service

MinRole: SingleServer

Service: Microsoft SharePoint Foundation Database
Service: Security Token Service
Service: Microsoft SharePoint Insights

MinRole: Invalid

Service: Microsoft SharePoint Foundation Database

MinRole: Search

Service: SSP Job Control Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft SharePoint Foundation Tracing
Service: SharePoint Server Search
Service: Microsoft SharePoint Foundation Timer
Service: Security Token Service
Service: Application Discovery and Load Balancer Service
Service: Microsoft SharePoint Foundation Usage
Service: Search Administration Web Service
Service: Claims to Windows Token Service
Service: Microsoft SharePoint Insights
Service: Search Host Controller Service
Service: Search Query and Site Settings Service

MinRole: Application

Service: Microsoft Project Server Events Service
Service: Secure Store Service
Service: PowerPoint Conversion Service
Service: Microsoft SharePoint Foundation Web Application
Service: Request Management
Service: SSP Job Control Service
Service: Project Server Application Service
Service: Managed Metadata Web Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft Project Server Calculation Service
Service: Microsoft SharePoint Foundation Tracing
Service: Microsoft SharePoint Foundation Timer
Service: App Management Service
Service: Security Token Service
Service: Machine Translation Service
Service: Microsoft Project Server Queuing Service
Service: Application Discovery and Load Balancer Service
Service: Microsoft SharePoint Foundation Usage
Service: Microsoft SharePoint Foundation Subscription Settings Service
Service: Word Automation Services
Service: Claims to Windows Token Service
Service: User Profile Service
Service: Business Data Connectivity Service
Service: Microsoft SharePoint Foundation Workflow Timer Service
Service: Microsoft SharePoint Insights
Service: Information Management Policy Configuration Service
Service: Microsoft SharePoint Foundation Incoming E-Mail

MinRole: DistributedCache

Service: Microsoft SharePoint Foundation Web Application
Service: Request Management
Service: SSP Job Control Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft SharePoint Foundation Tracing
Service: Microsoft SharePoint Foundation Timer
Service: Security Token Service
Service: Microsoft SharePoint Foundation Usage
Service: Claims to Windows Token Service
Service: Microsoft SharePoint Insights

MinRole: Custom

Service: Microsoft SharePoint Foundation Web Application
Service: SSP Job Control Service
Service: Microsoft SharePoint Foundation Administration
Service: Microsoft SharePoint Foundation Database
Service: Portal Service
Service: Microsoft SharePoint Foundation Tracing
Service: Microsoft SharePoint Foundation Timer
Service: Security Token Service
Service: Microsoft SharePoint Foundation Usage
Service: Claims to Windows Token Service
Service: Microsoft SharePoint Insights